Video encoding method and electronic device adapted thereto

ABSTRACT

A video encoding method and an electronic device adapted to the method are provided. The electronic device includes: a wireless communication circuit configured to communicate with a first electronic device, a touchscreen configured to display a user interface for performing a video call, a speaker, a microphone, one or more processors electrically connected to the communication circuit, the touchscreen, the speaker, and the microphone, and a memory electrically connected to the one or more processors, wherein the memory stores instructions that, when executed, cause the one or more processors to: receive a signal related to an incoming video call from the first electronic device via the wireless communication circuit, receive a user input accepting the video call via the user interface, transmit a signal accepting the video call to the first electronic device via the wireless communication circuit in response to the user input, receive a video stream from the first electronic device via the wireless communication circuit, wherein the video stream has been adapted at the first electronic device, based at least partly on: status information on the electronic device and/or status information on wireless communication between the electronic device and the first electronic device, display the received video stream on the touchscreen while providing voice from the video call, using the speaker, receive voice, using the microphone, and transmit the received voice to the first electronic device, using the wireless communication circuit.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.15/429,507, filed on Feb. 10, 2017, which claims priority to KoreanPatent Application No. 10-2016-0015656 filed on Feb. 11, 2016 and KoreanPatent Application No. 10-2016-0110572 filed on Aug. 30, 2016. Thecontents of each of these applications are incorporated herein in theirentirety.

BACKGROUND 1. Field

The present disclosure relates generally to a video encoding method andan electronic device adapted to the method.

2. Description of Prior Art

With the development of mobile communication technology and hardwaretechnology for electronic devices, a real-time video call is possiblebetween electronic devices and high-resolution video data can also betransmitted in real time between electronic devices.

When a real-time video call is connected between electronic devices, theelectronic device takes videos of the users via the cameras, encodes thetaken video data, and transmits the encoded video data to each party'selectronic devices via a network. A real time video call may refer, forexample, to a video call allowing two or more users to make a video allto each other in such a way that users' electronic devices synchronizevideo data with voice data, compress the data, and transmit thecompressed data to each other in streaming mode.

During the video call between two electronic devices, the electronicdevices take videos, encode the videos, and transmit the encoded data toeach other.

However, when an electronic device encodes video data suitable forplaying back between stationary devices with high resolution and largebattery capacity (level) and transmits the encoded data to a wearabledevice with low resolution and small (limited) battery capacity, thewearable device may have difficulty in playing back the encoded videodata. The encoding process is suitable for playing back video databetween electronic devices with high resolution and large batterycapacity (level), but is not suitable for wearable devices with lowresolution, low (limited) transfer rate, and small (limited) batterycapacity to receive and play back encoded video data. That is, thewearable devices may take a relatively long time to receive video dataencoded by and transmitted from the electronic device, due to thelimited transfer rate and may consume an excessive amount of batterypower.

SUMMARY

The present disclosure addresses the above problems and disadvantages,and provides at least the advantages described below. Accordingly, thepresent disclosure provides a video encoding method and an electronicdevice adapted to the method.

In accordance with an example aspect of the present disclosure, anelectronic device is provided. The electronic device includes: awireless communication circuit configured to communicate with a firstelectronic device, a touchscreen configured to display a user interfacefor performing a video call, a speaker, a microphone, one or moreprocessors electrically connected to the communication circuit, thetouchscreen, the speaker, and the microphone, and a memory electricallyconnected to the one or more processors, wherein the memory storesinstructions that, when executed, cause the one or more processors to:receive a signal related to an incoming video call from the firstelectronic device via the wireless communication circuit, receive a userinput accepting the video call via the user interface, transmit a signalaccepting the video call to the first electronic device via the wirelesscommunication circuit in response to the user input, receive a videostream from the first electronic device via the wireless communicationcircuit, wherein the video stream has been adapted at the firstelectronic device, based at least partly on: status information on theelectronic device and/or status information on wireless communicationbetween the electronic device and the first electronic device, displaythe received video stream on the touchscreen while providing voice fromthe video call, using the speaker, receive voice, using the microphone,and transmit the received voice to the first electronic device, usingthe wireless communication circuit.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features and attendant advantages of thepresent disclosure will be more apparent and readily understood from thefollowing detailed description, taken in conjunction with theaccompanying drawings, in which like reference numerals refer to likeelements, and wherein:

FIG. 1 is a diagram illustrating an example network environmentaccording to various example embodiments of the present disclosure;

FIG. 2 is a block diagram illustrating an example electronic deviceaccording to various example embodiments of the present disclosure;

FIG. 3 is a block diagram illustrating an example program moduleaccording to various example embodiments of the present disclosure;

FIG. 4 is a block diagram illustrating an example connection betweenfirst to third electronic devices according to various exampleembodiments of the present disclosure;

FIG. 5 is a block diagram illustrating an example electronic deviceaccording to various example embodiments of the present disclosure;

FIG. 6 is a signal flow diagram illustrating an example method for afirst electronic device to encode a video, while transmitting/receivingsignals to/from second and third electronic devices, according tovarious example embodiments of the present disclosure;

FIG. 7 is a signal flow diagram illustrating an example method for afirst electronic device to encode a video, while transmitting/receivingsignals to/from second and third electronic devices, according tovarious example embodiments of the present disclosure;

FIG. 8 is a signal flow diagram illustrating an example method for afirst electronic device to encode a video, while transmitting/receivingsignals to/from second and third electronic devices, according tovarious example embodiments of the present disclosure;

FIG. 9 is a signal flow diagram illustrating an example method for asecond electronic device to encode a video, while transmitting/receivingsignals to/from first and third electronic devices, according to variousexample embodiments of the present disclosure;

FIG. 10 is a diagram illustrating an example method of encoding videodata in a first electronic device according to various exampleembodiments of the present disclosure;

FIG. 11 is a diagram illustrating an example method of encoding videodata in a first electronic device according to various exampleembodiments of the present disclosure;

FIG. 12 is a diagram illustrating an example method of reproducingencoded video data in a third electronic device according to variousexample embodiments of the present disclosure;

FIG. 13 is a diagram illustrating an example method of encoding videodata in a second electronic device according to various exampleembodiments of the present disclosure;

FIG. 14A is a diagram illustrating an example method of encoding videodata in a second electronic device according to various exampleembodiments of the present disclosure;

FIG. 14B is a diagram illustrating an example post process according tovarious example embodiments of the present disclosure;

FIG. 15 is a diagram illustrating an example method of encoding videodata in a second electronic device according to various exampleembodiments of the present disclosure;

FIG. 16 is a flowchart illustrating an example method of reproducingvideo data in a third electronic device according to various exampleembodiments of the present disclosure;

FIGS. 17A and 17B are diagrams illustrating an example method ofencoding video data in a second electronic device according to variousexample embodiments of the present disclosure;

FIG. 18 is a diagram illustrating an example method of encoding videodata in a second electronic device according to various exampleembodiments of the present disclosure;

FIGS. 19A and 19B are diagrams illustrating an example user interfacerelated to the reception/transmission of a video call according tovarious example embodiments of the present disclosure;

FIGS. 20A, 20B, 20C and 20D are diagrams illustrating an example userinterface for receiving a video call according to various exampleembodiments of the present disclosure;

FIG. 20E is a flowchart illustrating an example method of performing avideo call in a third electronic device according to various exampleembodiments of the present disclosure;

FIGS. 21A and 21B are diagrams illustrating an example user interfacedepending on pressure levels of the user input according to variousexample embodiments of the present disclosure;

FIG. 21C is a flowchart illustrating example functions depending onpressure levels of the user input according to various exampleembodiments of the present disclosure;

FIG. 21D is a flowchart illustrating example functions depending onpressure levels of the user input according to various exampleembodiments of the present disclosure;

FIG. 21E is a flowchart illustrating example functions depending ondirections in which a user input is detected, according to variousexample embodiments of the present disclosure;

FIG. 22A are diagrams illustrating an example user interface includingan indicator indicating the quality of video call according to variousexample embodiments of the present disclosure;

FIG. 22B is a flowchart illustrating an example method of adjusting thequality of video call according to various example embodiments of thepresent disclosure;

FIGS. 23A and 23B are diagrams illustrating an example user interfacefor switching a video call device according to various exampleembodiments of the present disclosure;

FIG. 23C is a flowchart illustrating an example method of switching avideo call to a fourth electronic device according to various exampleembodiments of the present disclosure;

FIG. 24 is a diagram illustrating example operations of switching avideo call to a fourth electronic device according to various exampleembodiments of the present disclosure;

FIG. 25 is a signal flow diagram illustrating an example method ofswitching a video call to a fourth electronic device, flowing signalsbetween first, second and fourth electronic devices, according tovarious example embodiments of the present disclosure;

FIG. 26 is a signal flow diagram illustrating an example method ofswitching a video call to a fourth electronic device using an accountmanagement server, flowing signals between first, second and fourthelectronic devices, according to various example embodiments of thepresent disclosure;

FIG. 27 is a diagram illustrating an example user interface when a thirdelectronic device discovers nearby electronic devices and switches avideo call to an electronic device, according to various exampleembodiments of the present disclosure;

FIG. 28 is a diagram illustrating example connections among first tofourth electronic devices according to various example embodiments ofthe present disclosure;

FIG. 29 is a flowchart illustrating an example multiple connectionmethod according to various example embodiments of the presentdisclosure;

FIG. 30 is a flowchart illustrating an example method of storing videodata according to various example embodiments of the present disclosure;and

FIG. 31 is a diagram illustrating an example configuration of softwareaccording to various example embodiments of the present disclosure.

DETAILED DESCRIPTION

Hereinafter, the present disclosure is described with reference to theaccompanying drawings. Although various example embodiments areillustrated in the drawings and related detailed descriptions arediscussed in the disclosure, the present disclosure may have variousmodifications and several embodiments. However, various embodiments ofthe present disclosure are not limited to a specific implementation formand it should be understood that the present disclosure includes allchanges and/or equivalents and substitutes included in the spirit andscope of various embodiments of the present disclosure. In connectionwith descriptions of the drawings, similar components are designated bythe same reference numeral.

In various embodiments of the present disclosure, the terms such as“include”, “have”, “may include” or “may have” may be construed todenote a certain characteristic, number, step, operation, constituentelement, component or a combination thereof, but may not be construed toexclude the existence of or a possibility of addition of one or moreother characteristics, numbers, steps, operations, constituent elements,components or combinations thereof.

In various embodiments of the present disclosure, the expression “or” or“at least one of A or/and B” includes any or all of combinations ofwords listed together. For example, the expression “A or B” or “at leastA or/and B” may include A, may include B, or may include both A and B.

The expression “1”, “2”, “first”, or “second” used in variousembodiments of the present disclosure may modify various components ofthe various embodiments but does not limit the corresponding components.For example, the above expressions do not limit the sequence and/orimportance of the components. The expressions may be used fordistinguishing one component from other components. For example, a firstuser device and a second user device indicate different user devicesalthough both of them are user devices. For example, without departingfrom the scope of the present disclosure, a first structural element maybe referred to as a second structural element. Similarly, the secondstructural element also may be referred to as the first structuralelement.

When it is stated that a component is “(operatively or communicatively)coupled to” or “connected to” another component, the component may bedirectly coupled or connected to another component or a new componentmay exist between the component and another component. On the otherhand, when it is stated that a component is “directly coupled to” or“directly connected to” another component, a new component does notexist between the component and another component. In the presentdisclosure, the expression “configured (or set) to do” may be usedinterchangeably with, for example, “suitable for doing,” “having thecapacity to do,” “designed to do,” “adapted to do,” “made to do,” or“capable of doing.” The expression “configured (or set) to do” may notnecessarily be used to refer to only something in hardware for which itis “specifically designed to do.” Instead, the expression “a deviceconfigured to do” may indicate that the device is “capable of doing”something with other devices or parts. For example, the expression “aprocessor configured (or set) to do A, B and C” may refer to a dedicatedprocessor (e.g., an embedded processor) or a generic-purpose processor(e.g., CPU or application processor or any other processing circuitry)that may execute one or more software programs stored in a memory deviceto perform corresponding functions.

According to various embodiments, examples of the electronic device mayinclude a smartphone, a tablet Personal Computer (PC), a mobile phone, avideo phone, an electronic book reader, a desktop PC, a laptop PC, anetbook computer, a workstation, a server, a Personal Digital Assistant(PDA), a Portable Multimedia Player (PMP), an MP3 player, a medicaldevice, a camera, and a wearable device, or the like, but is not limitedthereto. Examples of the wearable device may include an accessory typedevice (such as, watch, ring, bracelet, ankle bracelet, necklace,glasses, contact lens, and Head-Mount Device (HMD)), a textile orclothes type device (such as electronic clothes), a body-attached type(such as skin pad and tattoo), and a bio-implemented type, or the like,but is not limited thereto. According to an embodiment, examples of theelectronic device may include a television, a Digital Video Disc (DVD)player, an audio player, a refrigerator, an air conditioner, a cleaner,an oven, a microwave oven, a laundry machine, an air purifier, a set-topbox, a home automation control panel, a security control panel, a mediabox (such as Samsung HomeSync™ apple TV™, and google TV™), a gameconsole (such as Xbox™ and PlayStation™), an electronic dictionary, anelectronic key, a camcorder, and an electronic frame, or the like, butis not limited thereto.

According to an embodiment, examples of the electronic device mayinclude a medical device (such as portable medical sensors (includingglucometer, heart rate sensor, tonometer, and body thermometer),Magnetic Resonance Angiography (MRA) device, Magnetic Resonance Imaging(MRI) device, Computed Tomography (CT) device, camcorder, and microwavescanner), a navigation device, a Global navigation Satellite System(GNSS), an Event Data Recorder (EDR), a Flight Data Recorder (FDR), anautomotive infotainment device, marine electronic equipment (such asmarine navigation system and gyro compass), aviation electronics(avionics), an automotive head unit, an industrial or household robot,an Automatic Teller Machine (ATM), a Point Of Sales (POS) terminal, andan Internet-of-Things (IoT) device (such as electric bulb, sensor,sprinkler system, fire alarm system, temperature controller, streetlamp, toaster, fitness equipment, hot water tank, heater, and boiler),or the like, but is not limited thereto.

According to an embodiment, examples of the electronic device mayinclude furniture, a building/structure, a part of a vehicle, anelectronic board, an electronic signature receiving device, a projector,and a sensor (such as water, electricity, gas, and electric wavemeters), or the like, but is not limited thereto. According to variousembodiments, the electronic device may be flexible or a combination ofat least two of the aforementioned devices. According to an embodiment,the electronic device is not limited to the aforementioned devices.

In the disclosure, the term “user” may denote a person who uses theelectronic device or a device (e.g., artificial intelligent electronicdevice) which uses the electronic device.

FIG. 1 is a diagram illustrating an example network environmentincluding electronic devices according to various example embodiments.

Referring to FIG. 1, electronic device (an electronic device 101, afirst external device 102 and a second external device 104) or server106 may be connected with network 162 through short-range communication164.

The electronic device 101, in a network environment 100, includes a bus110, a processor (e.g., including processing circuitry) 120, a memory130, an input/output interface (e.g., including input/output circuitry)150, a display 160, and a communication interface (e.g., includingcommunication circuitry) 170. According to some embodiments, theelectronic device 101 may omit at least one of the components or furtherinclude another component.

The bus 110 may be a circuit connecting the above described components110-170 and transmitting communication (e.g., a control message or data)between the above described components.

The processor 120 may include various processing circuitry, such as, forexample, and without limitation one or more of a dedicated processor, acentral processing unit (CPU), application processor (AP) orcommunication processor (CP). For example, the processor 120 may controlat least one component of the electronic device 101 and/or executecalculation relating to communication or data processing.

The memory 130 may include volatile and/or non-volatile memory. Forexample, the memory 130 may store command or data relating to at leastone component of the electronic device 101. According to someembodiment, the memory 130 may store software and/or program 140. Forexample, the program 140 may include a kernel 141, middleware 143, anapplication programming interface (API) 145, and/or an application 147and so on. At least one portion of the kernel 141, the middleware 143and the API 145 may be defined as operating system (OS).

The kernel 141 controls or manages system resources (e.g., the bus 110,the processor 120, or the memory 130) used for executing an operation orfunction implemented by the remaining other program, for example, themiddleware 143, the API 145, or the application 147. Further, the kernel141 provides an interface for accessing individual components of theelectronic device 101 from the middleware 143, the API 145, or theapplication 147 to control or manage the components.

The middleware 143 performs a relay function of allowing the API 145 orthe application 147 to communicate with the kernel 141 to exchange data.Further, in operation requests received from the application 147, themiddleware 143 performs a control for the operation requests (e.g.,scheduling or load balancing) by using a method of assigning a priority,by which system resources (e.g., the bus 110, the processor 120, thememory 130 and the like) of the electronic device 101 may be used, tothe application 147.

The API 145 is an interface by which the application 147 may control afunction provided by the kernel 141 or the middleware 143 and includes,for example, at least one interface or function (e.g., command) for afile control, a window control, image processing, or a charactercontrol.

The input/output interface 150 may include various input/outputcircuitry configured to provide an interface to transmit command or datainput by a user or another external device to another component(s) ofthe electronic device 101. Further, the input/output interface 150 mayoutput the command or data received from the another component(s) of theelectronic device 101 to the user or the another external device.

The display 160 may include, for example, liquid crystal display (LCD),light emitting diode (LED), organic LED (OLED), or micro electromechanical system (MEMS) display, or electronic paper display, or thelike, but is not limited thereto. The display 160 may display, forexample, various contents (text, image, video, icon, or symbol, and soon) to a user. The display 160 may include a touch screen, and receivetouch, gesture, approaching, or hovering input using a part of body ofthe user.

The communication interface 170 may include various communicationcircuitry configured to set communication of the electronic device 101and external device (e.g., a first external device 102, a secondexternal device 104, or a server 1106). For example, the communicationinterface 170 may be connected with the network 162 through wirelesscommunication or wire communication and communicate with the externaldevice (e.g., a second external device 104 or server 106).

Wireless communication may use, as cellular communication protocol, atleast one of LTE (long-term evolution), LTE-A (LTE Advance), CDMA (codedivision multiple access), WCDMA (wideband CDMA), UMTS (universal mobiletelecommunications system), WiBro (Wireless Broadband), GSM (GlobalSystem for Mobile Communications), and the like, for example. Ashort-range communication 164 may include, for example, at least one ofWi-Fi, Bluetooth, Near Field Communication (NFC), Magnetic SecureTransmission or near field Magnetic data Stripe Transmission (MST), andGlobal Navigation Satellite System (GNSS), and the like. The GNSS mayinclude at least one of, for example, a Global Positioning System (GPS),a Global navigation satellite system (Glonass), a Beidou NavigationSatellite System (hereinafter, referred to as “Beidou”), and Galileo(European global satellite-based navigation system). Hereinafter, the“GPS” may be interchangeably used with the “GNSS” in the disclosure.Wired communication may include, for example, at least one of USB(universal serial bus), HDMI (high definition multimedia interface),RS-232 (recommended standard-232), POTS (plain old telephone service),and the like. The network 162 may include telecommunication network, forexample, at least one of a computer network (e.g., LAN or WAN),internet, and a telephone network.

Each of the first external device 102 and the second external device 104may be same type or different type of device with the electronic device101. According to some embodiment, the server 106 may include one ormore group of servers. According to various embodiment, at least oneportion of executions executed by the electronic device may be performedby one or more electronic devices (e.g., external electronic device 102,104, or server 106). According to some embodiments, when the electronicdevice 101 should perform a function or service automatically, theelectronic device 101 may request performing of at least one function toanother device (e.g., external electronic device 102, 104, or server106). The another device (e.g., external electronic device 102, 104, orserver 106) may perform the requested function or additional function,and may transfer a result of the performance to the electronic device101. The electronic device 101 may additionally process the receivedresult to provide the requested function or service. For the above,cloud computing technology, distributed computing technology, orclient-server computing technology may be used, for example.

FIG. 2 is a block diagram illustrating an example electronic deviceaccording to various example embodiments.

Referring to FIG. 2, an electronic device 201 may include, for example,a whole or a part of the electronic device 101 illustrated in FIG. 1.The electronic device 201 includes one or more APs (e.g., includingprocessing circuitry) 210, a communication module (e.g., includingcommunication circuitry) 220, a subscriber identification module (SIM)card 224, a memory 230, a sensor module 240, an input device (e.g.,including input circuitry) 250, a display 260, an interface (e.g.,including interface circuitry) 270, an audio module 280, a camera module291, a power managing module 295, a battery 296, an indicator 297, and amotor 298.

The AP 210 may include various processing circuitry and operates an OSor an application program so as to control a plurality of hardware orsoftware component elements connected to the AP 210 and execute variousdata processing and calculations including multimedia data. The AP 210may be implemented by, for example, a system on chip (SoC). According toan embodiment, the processor 210 may further include a graphicsprocessing unit (GPU) and/or image signal processor. The AP 210 mayinclude at least one portion of components illustrated in FIG. 2 (e.g.,a cellular module 221). The AP 210 may load command or data receivedfrom at least one of another component (e.g., non-volatile memory),store various data in the non-volatile memory.

The communication module 220 may include the same or similar componentswith the communication interface 170 of FIG. 1. The communication module220 may include various communication circuitry therein, such as, forexample, and without limitation, a cellular module 221, a Wi-Fi module223, a BT module 225, a GPS module 227, a NFC module 228, and a radiofrequency (RF) module 229.

The cellular module 221 provides a voice, a call, a video call, a shortmessage service (SMS), or an internet service through a communicationnetwork (e.g., LTE, LTE-A, CDMA, WCDMA, UMTS, WiBro, GSM and the like).Further, the cellular module 221 may distinguish and authenticateelectronic devices within a communication network by using a SIM (e.g.,the SIM card 224). According to an embodiment, the cellular module 221performs at least some of the functions which may be provided by the AP210. For example, the cellular module 221 may perform at least some ofthe multimedia control functions. According to an embodiment, thecellular module 221 may include a CP.

Each of the Wi-Fi module 223, the BT module 225, the GPS module 227, andthe NFC module 228 may include, for example, a processor for processingdata transmitted/received through the corresponding module.

According to various embodiments, at least part of the cellular module221, the Wi-Fi module 223, the BT module 225, the GPS module 227, andthe NFC module 228 may be included in one integrated chip (IC) or one ICpackage.

The RF module 229 transmits/receives data, for example, an RF signal.Although not illustrated, the RF module 229 may include, for example, atransceiver, a power amp module (PAM), a frequency filter, a low noiseamplifier (LNA), antenna and the like.

According to various embodiments, at least one of the cellular module221, the Wi-Fi module 223, the BT module 225, the GPS module 227, andthe NFC module 228 may transmit/receive an RF signal through a separateRF.

The SIM card 224 may refer, for example, to a card including a SIM andmay be inserted into a slot formed in a particular portion of theelectronic device. The SIM card 224 includes unique identificationinformation (e.g., integrated circuit card identifier (ICCID)) orsubscriber information (e.g., international mobile subscriber identity(IMSI).

The memory 230 (e.g., memory 130) may include an internal memory 232and/or an external memory 234. The internal memory 1232 may include, forexample, at least one of a volatile memory (e.g., a random access memory(RAM), a dynamic RAM (DRAM), a static RAM (SRAM), a synchronous dynamicRAM (SDRAM), and the like), and a non-volatile Memory (e.g., a read onlymemory (ROM), a one time programmable ROM (OTPROM), a programmable ROM(PROM), an erasable and programmable ROM (EPROM), an electricallyerasable and programmable ROM (EEPROM), a mask ROM, a flash ROM, a notand (NAND) flash memory, a not or (NOR) flash memory, etc.), a harddrive, a solid state drive (SSD), etc.

According to an embodiment, the external memory 234 may further includea flash drive, for example, a compact flash (CF), a secure digital (SD),a micro-SD, a mini-SD, an extreme digital (xD), or a memory stick. Theexternal memory 1234 may be functionally connected to the electronicdevice 201 through various interfaces. According to an embodiment, theelectronic device 201 may further include a storage device (or storagemedium) such as a hard drive.

The sensor module 240 measures a physical quantity or detects anoperation state of the electronic device 201, and converts the measuredor detected information to an electronic signal. The sensor module 240may include, for example, at least one of a gesture sensor 240A, a gyrosensor 240B, an atmospheric pressure (barometer) sensor 240C, a magneticsensor 240D, an acceleration sensor 240E, a grip sensor 240F, aproximity sensor 240G, a color sensor 240H (e.g., red, green, and blue(RGB) sensor) 240H, a biometric sensor 240I, a temperature/humiditysensor 240J, an illuminance (e.g., light) sensor 240K, and a ultraviolet(UV) sensor 240M. Additionally or alternatively, the sensor module 240may include, for example, an E-nose sensor, an electromyography (EMG)sensor, an electroencephalogram (EEG) sensor, an electrocardiogram (ECG)sensor, an infrared (IR) sensor, an iris sensor, a fingerprint sensor(not illustrated), and the like. The sensor module 240 may furtherinclude a control circuit for controlling one or more sensors includedin the sensor module 240. In embodiments, the electronic device 201 iscapable of including a processor, configured as part of the processor210 or a separate component, for controlling the sensor module 240. Inthis case, while the processor 210 is operating in sleep mode, theprocessor is capable of controlling the sensor module 240.

The input device 250 may include various input circuitry, such as, forexample, and without limitation, a touch panel 252, a (digital) pensensor 254, a key 256, and an ultrasonic input device 258. For example,the touch panel 252 may recognize a touch input in at least one type ofa capacitive type, a resistive type, an infrared type, and an acousticwave type. The touch panel 252 may further include a control circuit. Inthe capacitive type, the touch panel 252 may recognize proximity as wellas a direct touch. The touch panel 252 may further include a tactilelayer. In this event, the touch panel 252 provides a tactile reaction tothe user.

The (digital) pen sensor 254 may be implemented, for example, using amethod identical or similar to a method of receiving a touch input ofthe user, or using a separate recognition sheet. The key 256 mayinclude, for example, a physical button, an optical key, or a key pad.The ultrasonic input device 258 is a device which may detect an acousticwave by a microphone (e.g., a microphone 288) through an input meansgenerating an ultrasonic signal to identify data and may performwireless recognition.

The display 260 (e.g., display 160) includes a panel 262, a hologramunit or device 264, and a projector 266. The panel 262 may beimplemented to be, for example, flexible, transparent, or wearable. Thepanel 262 may also be incorporated into one module together with thetouch panel 252. The According to one embodiment, the panel 262 mayinclude a pressure sensor (or force sensor) capable of measuring theintensity of the pressure on the user's touch. The pressure sensor maybe integrated with the touch panel 252, or may be implemented by one ormore sensors separate from the touch panel 252. The hologram device 264shows a stereoscopic image in the air by using interference of light.The projector 266 projects light on a screen to display an image. Forexample, the screen may be located inside or outside the electronicdevice 201. According to an embodiment, the display 260 may furtherinclude a control circuit for controlling the panel 262, the hologramdevice 264, and the projector 266.

The interface 270 may include various interface circuitry, such as, forexample, and without limitation, a HDMI 272, an USB 274, an opticalinterface 276, and a D-subminiature (D-sub) 278. The interface 270 maybe included in, for example, the communication interface 170 illustratedin FIG. 1. Additionally or alternatively, the interface 270 may include,for example, a mobile high-definition link (MHL) interface, an SDcard/multi-media card (MMC), or an infrared data association (IrDA)standard interface.

The audio module 280 bi-directionally converts a sound and an electronicsignal. At least some components of the audio module 280 may be includedin, for example, the input/output interface 150 illustrated in FIG. 1.The audio module 280 processes sound information input or outputthrough, for example, a speaker 282, a receiver 284, an earphone 286,the microphone 288 and the like.

The camera module 291 is a device which may photograph a still image anda video. According to an embodiment, the camera module 291 may includeone or more image sensors (e.g., a front sensor or a back sensor), animage signal processor (ISP) (not shown) or a flash (e.g., an LED orxenon lamp).

The power managing module 295 manages power of the electronic device201. Although not illustrated, the power managing module 295 mayinclude, for example, a power management integrated circuit (PMIC), acharger IC, or a battery or fuel gauge.

The PMIC may be mounted to, for example, an integrated circuit or a SoCsemiconductor. A charging method may be divided into wired and wirelessmethods. The charger IC charges a battery and prevent over voltage orover current from flowing from a charger. According to an embodiment,the charger IC includes a charger IC for at least one of the wiredcharging method and the wireless charging method. The wireless chargingmethod may include, for example, a magnetic resonance method, a magneticinduction method and an electromagnetic wave method, and additionalcircuits for wireless charging, for example, circuits such as a coilloop, a resonant circuit, a rectifier and the like may be added.

The battery fuel gauge measures, for example, a remaining quantity ofthe battery 296, or a voltage, a current, or a temperature duringcharging. The battery 296 may store or generate electricity and supplypower to the electronic device 201 by using the stored or generatedelectricity. The battery 296 may include a rechargeable battery or asolar battery.

The indicator 297 shows particular statuses of the electronic device 201or a part (e.g., AP 210) of the electronic device 201, for example, abooting status, a message status, a charging status and the like. Themotor 298 converts an electrical signal to a mechanical vibration.Although not illustrated, the electronic device 201 may include aprocessing unit (e.g., GPU) for supporting a module TV. The processingunit for supporting the mobile TV may process, for example, media dataaccording to a standard of digital multimedia broadcasting (DMB),digital video broadcasting (DVB), media flow and the like.

Each of the components of the electronic device according to variousembodiments may be implemented by one or more components and the name ofthe corresponding component may vary depending on a type of theelectronic device. The electronic device according to variousembodiments may include at least one of the above described components,a few of the components may be omitted, or additional components may befurther included. Also, some of the components of the electronic deviceaccording to various embodiments may be combined to form a singleentity, and thus may equivalently execute functions of the correspondingcomponents before being combined.

FIG. 3 is a block diagram illustrating an example programming moduleaccording to various example embodiments.

Referring to FIG. 3, a programming module 310 may be included, e.g.stored, in the electronic apparatus 100, e.g. the memory 130, asillustrated in FIG. 1. At least a part of the programming module 310(e.g., program 140) may be realized by software, firmware, hardware,and/or combinations of two or more thereof. The programming module 310may include an OS that is implemented in hardware, e.g., the hardware200 to control resources related to an electronic device, e.g., theelectronic device 100, and/or various applications. e.g., application147, driven on the OS. For example, the OS may be Android, iOS, Windows,Symbian, Tizen, Bada, and the like.

Referring to FIG. 3, the programming module 310 may include a kernel 320(e.g., kernel 141, middleware 330 (e.g., middleware 143), an API 360(e.g., API 145), and the applications 370 (e.g., application 147). Atleast part of the program module 310 may be preloaded on the electronicdevice or downloaded from a server (e.g., an electronic device 102, 104,server 106, etc.).

The kernel 320 may include a system resource manager 321 and/or a devicedriver 323. The system resource manager 321 may control, allocate,and/or collect system resources. The system resource manager 321 mayinclude, for example, a process manager, a memory manager, and a filesystem manager. The device driver 323 may include, for example, adisplay driver, a camera driver, a BT driver, a shared memory driver, aUSB driver, a keypad driver, a Wi-Fi driver, and an audio driver.Further, according to an embodiment, the device driver 323 may includean inter-process communication (IPC) driver (not illustrated).

The middleware 330 may include a plurality of modules implemented inadvance for providing functions commonly used by the applications 370.Further, the middleware 330 may provide the functions through the API360 such that the applications 370 may efficiently use restricted systemresources within the electronic apparatus. For example, as illustratedin FIG. 3, the middleware 330 may include at least one of a runtimelibrary 335, an application manager 341, a window manager 342, amultimedia manager 343, a resource manager 344, a power manager 345, adatabase manager 346, a package manager 347, a connectivity (e.g.,connection) manager 348, a notification manager 349, a location manager350, a graphic manager 351, and a security manager 352.

The runtime library 335 may include a library module that a compileruses in order to add a new function through a programming language whileone of the applications 370 is being executed. According to anembodiment, the runtime library 335 may perform an input/output, memorymanagement, and/or a function for an arithmetic function.

The application manager 341 may manage a life cycle of at least one ofthe applications 370. The window manager 342 may manage graphical userinterface (GUI) resources used by a screen. The multimedia manager 343may detect formats used for reproduction of various media files, and mayperform encoding and/or decoding of a media file by using a codecsuitable for the corresponding format. The resource manager 344 maymanage resources such as a source code, a memory, and a storage space ofat least one of the applications 370.

The power manager 345 may manage a battery and/or power, while operatingtogether with a basic input/output system (BIOS), and may provide powerinformation used for operation. The database manager 346 may managegeneration, search, and/or change of a database to be used by at leastone of the applications 370. The package manager 347 may manageinstallation and/or an update of an application distributed in a form ofa package file.

For example, the connectivity manager 348 may manage wirelessconnectivity such as Wi-Fi or BT. The notification manager 349 maydisplay and/or notify of an event, such as an arrival message, apromise, a proximity notification, and the like, in such a way that doesnot disturb a user. The location manager 350 may manage locationinformation of an electronic apparatus. The graphic manager 351 maymanage a graphic effect which will be provided to a user, and/or a userinterface related to the graphic effect. The security manager 352 mayprovide all security functions used for system security and/or userauthentication. According to an embodiment, when an electronicapparatus, e.g., the electronic apparatus 100, has a telephone callfunction, the middleware 330 may further include a telephony manager(not illustrated) for managing a voice and/or video communicationfunction of the electronic apparatus.

The middleware 330 may generate and use a new middleware module throughvarious functional combinations of the aforementioned internal elementmodules. The middleware 330 may provide modules specialized according totypes of OSs in order to provide differentiated functions. Further, themiddleware 330 may dynamically remove some of the existing elementsand/or add new elements. Accordingly, the middleware 330 may excludesome of the elements described in the various embodiments, furtherinclude other elements, and/or substitute the elements with elementshaving a different name and performing a similar function.

The API 360 is a set of API programming functions, and may be providedwith a different configuration according to the OS. For example, in acase of Android or iOS, one API set may be provided for each ofplatforms, and in a case of Tizen, two or more API sets may be provided.

The applications 370 may include one or more applications for performingvarious functions, e.g., home 371, dialer 372, SMS/MMS 373, instantmessage (IM) 374, browser 375, camera 376, alarm 377, contact 378, voicedial 379, email 380, calendar 381, media player 382, album 383, clock384, health care (e.g., an application for measuring amount of exercise,blood sugar level, etc.), and environment information (e.g., anapplication for providing atmospheric pressure, humidity, temperature,etc.), not shown.

According to an embodiment, the applications 370 are capable ofincluding an application for supporting information exchange between anelectronic device and an external device, which is hereafter called‘information exchange application’. The information exchange applicationis capable of including a notification relay application for relayingspecific information to external devices or a device managementapplication for managing external devices.

For example, the notification relay application is capable of includinga function for relaying notification information, created in otherapplications of the electronic device to external devices. In addition,the notification relay application is capable of receiving notificationinformation from external devices to provide the received information tothe user.

The device management application is capable of managing (e.g.,installing, removing or updating) at least one function of an externaldevice communicating with the electronic device. Examples of thefunction are a function of turning-on/off the external device or part ofthe external device, a function of controlling the brightness (orresolution) of the display, applications running on the external device,services provided by the external device, etc. Examples of the servicesare a call service, messaging service, etc.

According to an embodiment, the applications 370 are capable ofincluding an application (e.g., a health care application of a mobilemedical device, etc.) specified attributes of an external device.According to an embodiment, the applications 370 are capable ofincluding applications received from an external device. According to anembodiment, the applications 370 are capable of including a preloadedapplication or third party applications that can be downloaded from aserver. It should be understood that the components of the programmodule 310 may be called different names according to types of operatingsystems.

According to various embodiments, at least part of the program module310 can be implemented with software, firmware, hardware, or anycombination of two or more of them. At least part of the program module310 can be implemented (e.g., executed) by a processor (e.g., processor210). At least part of the programming module 310 may include modules,programs, routines, sets of instructions or processes, etc., in order toperform one or more functions.

The term “module” used in the disclosure may refer to, for example, aunit including at least one combination of hardware (e.g., circuitry),software, and firmware. The “module” may be interchangeably used with aterm, such as unit, logic, logical block, component, and/or circuit. The“module” may be a minimum unit of an integrally configured articleand/or a part thereof. The “module” may be a minimum unit performing atleast one function and/or a part thereof. The “module” may bemechanically and/or electronically implemented. For example, the“module” according to the disclosure may include at least one ofprocessing circuitry (e.g., a CPU), a dedicated processor, anapplication-specific IC (ASIC) chip, a field-programmable gate arrays(FPGA), and a programmable-logic device for performing operations whichhas been known and/or are to be developed.

According to various embodiments, at least some of the devices (e.g.,modules or functions thereof) or the method (e.g., operations) accordingto the disclosure may be implemented by a command stored in acomputer-readable storage medium in a programming module form. When theinstructions are executed by at least one processor (e.g., the processor120), the at least one processor may perform functions corresponding tothe instructions. The computer-readable storage medium may be, forexample, the memory 130. At least a part of the programming module maybe implemented (e.g., executed) by, for example, the processor 120. Atleast some of the programming modules may include, for example, amodule, a program, a routine, a set of instructions or a process forperforming one or more functions.

The computer-readable recording medium may include magnetic media suchas a hard disk, a floppy disk, and a magnetic tape, optical media suchas a compact disc ROM (CD-ROM) and a DVD, magneto-optical media such asa floptical disk, and hardware devices specially configured to store andperform a program instruction (e.g., programming module), such as a ROM,a RAM, a flash memory and the like. In addition, the programinstructions may include high class language codes, which may beexecuted in a computer by using an interpreter, as well as machine codesmade by a compiler. The aforementioned hardware device may be configuredto operate as one or more software modules in order to perform theoperation of the disclosure, and vice versa.

The module or programming module of the disclosure may include at leastone of the aforementioned components with omission of some components oraddition of other components. The operations of the modules, programmingmodules, or other components may be executed in series, in parallel,recursively, or heuristically. Also, some operations may be executed indifferent order, omitted, or extended with other operations.

FIG. 4 is a block diagram illustrating an example connection betweenfirst to third electronic devices according to various embodiments ofthe present disclosure.

With reference to FIG. 4, various embodiments of the present disclosureare described assuming that: a first electronic device 401 is anelectronic device (calling electronic device) transmitting a video callrequest signal; a second electronic device 403 is an electronic device(referred to herein as electronic device) receiving the video callrequest signal from the first electronic device 401; and a thirdelectronic device 405 is an electronic device, connected to the secondelectronic device 403, which receives the video call request signal fromthe second electronic device 403 and performs a video call with thefirst electronic device 401. For example, the third electronic device405 may be a wearable device whose display size is, for example, lessthan or equal to 4 inches.

In various embodiments of the present disclosure, the first electronicdevice 401 and the second electronic device 403 are connected to eachother via a first network 411, e.g., 3G or LTE network. The secondelectronic device 403 and the third electronic device 405 are connectedto each other via a second network 413, e.g., a low-power network, suchas a Bluetooth or Wi-Fi network.

In various embodiments of the present disclosure, the third electronicdevice 405 has a display which is smaller in size than those of thefirst electronic device 401 and the second electronic device 403. Forexample, the third electronic device 405 has a display size of 4 inches.The first electronic device 401 and the second electronic device 403have a display size of 7 inches. The smaller the display size of thethird electronic device 405, the lower the resolution that the thirdelectronic device 405 supports compared to the first electronic device401 and the second electronic device 403. As described above, the thirdelectronic device 405 is capable of operating according to: a signaldetected via its sensor; or a control signal received from the secondelectronic device 403 via the second network 413, e.g., a low powernetwork such as Bluetooth or Wi-Fi network.

In various embodiments of the present disclosure, video data, related toa video call performed by the third electronic device 405 connected tothe first and second electronic devices 401 and 403 via the secondnetwork 413, may be processed (e.g., encoded) by the first electronicdevice 401 or the second electronic device 403.

Processing video data related to a video call performed by the firstelectronic device 401 will be described in greater detail below withreference to FIGS. 6 to 8.

Processing video data related to a video call performed by the secondelectronic device 403 will be described in greater detail below withreference to FIG. 9.

FIG. 5 is a block diagram illustrating an example electronic deviceaccording to various embodiments of the present disclosure.

With reference to FIG. 5, the electronic device may include a wirelesscommunication circuit 510, a memory 520, a touchscreen 530, a sensor540, a camera 550, an audio processing 560, and a processor 570.

In various embodiments of the present disclosure, the electronic deviceserves as: an electronic device (calling electronic device) making avideo call request, e.g., the first electronic device 401 illustrated inFIG. 4; an electronic device (called electronic device) receiving thevideo call request, e.g., the second electronic device 403 illustratedin FIG. 4; and an electronic device accepting the video call request andperforming a video call, e.g., the third electronic device 405illustrated in FIG. 4.

In various embodiments of the present disclosure, the wirelesscommunication circuit 510 (e.g., the communication interfaces 170 and220 illustrated in FIGS. 1 and 2, respectively) may include variouscommunication circuitry and is capable of connecting to (including)first and second networks. The first network is capable of connecting,in communication, an electronic device (calling electronic device)making a video call request, e.g., the first electronic device 401illustrated in FIG. 4, and an electronic device (called electronicdevice) receiving the video call request, e.g., the second electronicdevice 403 illustrated in FIG. 4. The second network is capable ofconnecting, in communication, the electronic device (called electronicdevice) receiving the video call request, e.g., the second electronicdevice 403 illustrated in FIG. 4, and an electronic device accepting thevideo call request and performing a video call, e.g., the thirdelectronic device 405 illustrated in FIG. 4. The electronic devices arecapable of transmitting/receiving a video call request signal and theacceptance signal in response to the video call request signal to/fromeach other via the first and second networks. The electronic devices arecapable of transmitting/receiving video data for a video call andinformation regarding the electronic devices to/from each other via thefirst and second networks.

In various embodiments of the present disclosure, the memory 520 (e.g.,the memory 130 illustrated in FIG. 1 and the memory 230 illustrated inFIG. 2) is capable of storing information regarding at least oneelectronic device capable of performing a video call, e.g., a type ofelectronic device, a display size, a form (e.g., a circle, a rectangle,a square, or the like), the battery capacity; the screen resolution, CPUpower consumption, etc. The memory 520 is also capable of mapping andstoring a function or a user interface, displayed according to: adirection in which the user input is detected, a user input, a durationof the user input, a level of a hovering input, or a pressure level ofthe user input.

In various embodiments of the present disclosure, the touchscreen 530 iscapable of including a display unit 531 (e.g., displays 160 and 260illustrated in FIGS. 1 and 2 respectively) and a touch panel 533 (e.g.,the input module 250 illustrated in FIG. 2), configuring into a singlebody.

In various embodiments of the present disclosure, the display unit 531is capable of displaying a user interface for controlling functionsrelated to a video call. The display unit 531 is capable of displayingvideo data for performing a video call. When the display unit 531detects a user input under the control of the processor 570, it iscapable of displaying a user interface, based on a duration of thedetected user input, a pressure level of the detected user input, or adirection in which the user input is detected. When the display unit 531detects a hovering input under the control of the processor 570, it iscapable of analyzing a level of the detected hovering input anddisplaying a user interface mapped to the analyzed hovering input level.

In various embodiments of the present disclosure, the sensor 540 (e.g.,the sensor module 240 illustrated in FIG. 2) is capable of measuring aphysical quantity or detecting an operation state of the electronicdevice, and converting the measured or detected physical quantity intoan electrical signal. The sensor 540 is capable of including at leastone of the following: a gesture sensor, a gyro sensor, an accelerationsensor, and a geomagnetic sensor. In various embodiments of the presentdisclosure, when the sensor 540 includes a geomagnetic sensor, theelectronic device is capable of measuring a movement angle of its headvia the geomagnetic sensor. When the sensor 540 includes an accelerationsensor and a gyro sensor, the electronic device is capable of detectingits movement via the acceleration sensor and the gyro sensor. The sensor540 is capable of transferring, to the processor 570, the sensedinformation according to the movement of the electronic device and themeasured movement angle of the electronic device. The sensor 540 iscapable of collecting external environment information of the electronicdevice, including at least one of the following: weather information,brightness information, and sound information.

In various embodiments of the present disclosure, when the electronicdevice serves as a first electronic device 401 (e.g., a callingelectronic device making a video call request), the processor 570controls: the camera 550 (e.g., the camera module 291 illustrated inFIG. 2) to take a video of a subject; and the wireless communicationcircuit 510 to transmit the video data taken from the subject to thesecond electronic device 403.

In various embodiments of the present disclosure, when the electronicdevice serves as a third electronic device 405 (e.g., an electronicdevice accepting a video call request and performing a video call), theprocessor 570 controls: the camera 550 to take a video of a subject; andthe wireless communication circuit 510 to transmit the video data takenfrom the subject to the second electronic device 403. The camera 550 iscapable of recognizing at least one of the following: a user's face anda user's iris from the video data taken from a subject. In variousembodiments of the present disclosure, the audio processing unit 560(e.g., the audio module 280 illustrated in FIG. 2) is connected to aspeaker (SPK) 561 and/or a microphone (MIC) 563. The speaker 561 outputsaudio signals transmitted/received during the call (transmission soundor reception sound), audio signals including a received message, audiosignals when an audio file stored in the memory 433 is played, etc. Themicrophone 563 receives a user's voice or other audios.

In various embodiments of the present disclosure, when the audioprocessing unit 560 receives a voice for controlling functions relatedto a video call via the microphone 563, it is capable of transferringthe voice signal to the processor 570. The audio processing unit 560 iscapable of extracting voices from the video data received from the firstelectronic device 401, under the control of the processor 570, andoutputting the extracted voices via the speaker 561. The audioprocessing unit 560 is capable of outputting, via the speaker 561, audiosignals related to a notification of switching to a video call, thereception of a video call, etc.

In various embodiments of the present disclosure, when the electronicdevice serves as a first electronic device 401 (e.g., a callingelectronic device making a video call request), the processor 570 (e.g.,processors 120 and 210 illustrated in FIGS. 1 and 2 respectively) iscapable of requesting the video call connection from the secondelectronic device 403 (e.g., a called electronic device receiving thevideo call request) or the third electronic device 405 (e.g., anelectronic device accepting the video call request and performing avideo call), via the wireless communication circuit 510. When theprocessor 570 receives an acceptance signal in response to the videocall connection request from the second electronic device 403 or thethird electronic device 405, it is capable of obtaining statusinformation regarding the second electronic device 403, statusinformation regarding the third electronic device 405, and networkconnection information.

In various embodiments of the present disclosure, the processor 570 iscapable of determining an encoding scheme for video data (e.g., videostream) taken by the camera 550, based on the obtained information. Theprocessor 570 is capable of encoding video data, based on the determinedencoding scheme, and transmitting the encoded video data to the secondelectronic device 403 or the third electronic device 405. The processor570 is capable of creating a number of images, extracting audio signals,based on the video data, and transmitting the created and extractedresult to the second electronic device 403 or the third electronicdevice 405. The processor 570 is capable of: detecting at least one ofthe following, a maximum resolution, a maximum picture quality, and amaximum fps, supported by the second electronic device 403 or the thirdelectronic device 405; adjusting at least one of the maximum resolution,the maximum picture quality, and the maximum fps, based on statusinformation regarding the second network; and encoding video data basedon at least one of the adjusted resolution, the adjusted picturequality, and the adjusted fps. In various embodiments of the presentdisclosure, when the processor 570 receives video data for the thirdelectronic device 405 from the second electronic device 403, it iscapable of determining an encoding scheme, based on the received videodata, and encoding the video data based on the determined encodingscheme. In various embodiments of the present disclosure, when theprocessor 570 receives a value for adjusting quality of video data(e.g., a value of change in picture quality, a value of change inresolution, a value of change in fps) from the second electronic device403, it is capable of encoding the video data based on the receivedquality adjustment value and a transfer rate based on the networkstates, and transmitting the encoded video data to the second electronicdevice 403.

It should be understood that the operation of determining an encodingscheme and the operation of encoding video data based on the determinedencoding scheme, described above, may also be applied to the secondelectronic device 403 in the same ways as the first electronic device401.

In various embodiments of the present disclosure, in a state where theelectronic device serves as a second electronic device 403 (e.g., acalled electronic device receiving the video call request), when theprocessor 570 receives a video call request signal from the firstelectronic device 401 (e.g., a calling electronic device making a videocall request) via the wireless communication circuit 510, the processor570 is capable of transmitting the video call request signal to thethird electronic device 405 (e.g., an electronic device accepting thevideo call request and performing a video call). When the processor 570receives an acceptance signal in response to the video call connectionrequest from the third electronic device 405, it is capable oftransmitting the acceptance signal to the first electronic device 401.The processor 570 is capable of forwarding controls signals and videodata for a video call between the first and third electronic devices 401and 405.

In various embodiments of the present disclosure, when the electronicdevice serves as a third electronic device 405 (e.g., an electronicdevice accepting the video call request and performing a video call),the processor 570 is capable of receiving a video call request signalfrom the second electronic device 403 (e.g., a called electronic devicereceiving the video call request) via wireless communication circuit510. When the processor 570 detects a user input accepting the videocall request, it is capable of transmitting an acceptance signal inresponse to the video call request to the second electronic device 403.The processor 570 is capable of: receiving video data, encoded based oninformation the second network and status information regarding thethird electronic device 405, from the second electronic device 403; andreproducing the received video data. In various embodiments of thepresent disclosure, the processor 570 is capable of: receiving a numberof images and audio signals, created based on information the secondnetwork and status information regarding the third electronic device405, from the second electronic device 403; and reproducing the receivedimages and audio signals.

In various embodiments of the present disclosure, the processor 570takes a video of a subject via the camera 550 and transmits the videodata taken from the subject to the second electronic device 403. Theprocessor 570 is capable of encoding video data, based on statusinformation regarding the third electronic device 405 and statusinformation regarding the second network, and transmitting the encodedvideo data to the second electronic device 403. In various embodimentsof the present disclosure, the processor 570 is capable of displayingthe encoded video data and an indicator for adjusting the quality of thevideo data. The processor 570 is capable of detecting an input foradjusting the quality of video data via the indicator. The processor 570is capable of determining a quality adjustment value corresponding tothe detected input (e.g., a value of change in picture quality, a valueof change in resolution, a value of change in fps), and transmitting thedetermined value to the second electronic device 403. The processor 570is capable of receiving video data, encoded based on the adjustedquality value, from the second electronic device 403, and reproducingthe encoded video data. The processor 570 is capable of detecting themovement of the third electronic device 405 via the sensor 540. Theprocessor 570 collects sensed information regarding the movement of thethird electronic device 405 and reproduces video data and/or audiosignals, based on the sensed information. For example, when theprocessor 570 ascertains that the sensed information regarding themovement of the electronic device is within a preset range, itreproduces the audio signals and stores the video data in the memory520. When the processor 570 ascertains that the sensed informationregarding the movement of the electronic device is not within a presetrange, it reproduces video data stored in the memory 520. When theprocessor 570 detects a signal for switching a video call currently inprogress to other devices, it is capable of searching for and displayingat least one electronic device to which the video call can be switched.When the processor 570 detects an input selecting an electronic deviceto be switched for the video call from among one or more electronicdevices which is/are displayed, for a preset period of time, it iscapable of transmitting a video call switching signal to the selectedelectronic device. On the other hand, when the processor 570 has notdetected an input selecting an electronic device to be switched for thevideo call from among one or more electronic devices which is/aredisplayed, for a preset period of time, it is capable of capable of:analyzing status information regarding the one or more electronicdevices which are displayed, information status regarding the secondnetwork; assigning the priority to electronic devices; and automaticallyselecting an electronic device with higher priority as an electronicdevice to be switched for the video call.

In various embodiments of the present disclosure, an electronic deviceis implemented to include: a wireless communication circuit configuredto communicate with a first electronic device, a touchscreen configuredto display a user interface for performing a video call, a speaker, amicrophone, one or more processors electrically connected to thecommunication circuit, the touchscreen, the speaker, and the microphone,and a memory electrically connected to the one or more processors. Thememory stores instructions that, when executed, cause the one or moreprocessors to: receive a signal related to an incoming video call fromthe first electronic device via the wireless communication circuit,receive a user input accepting the video call via the user interface,transmit a signal accepting the video call to the first electronicdevice via the wireless communication circuit in response to the userinput, receive a video stream from the first electronic device via thewireless communication circuit, the video stream has been adapted at thefirst electronic device, based at least partly on: status information onthe electronic device and/or status information on wirelesscommunication between the electronic device and the first electronicdevice, display the received video stream on the touchscreen whileproviding voice from the video call, using the speaker, receive voice,using the microphone, and transmit the received voice to the firstelectronic device, using the wireless communication circuit.

According to various embodiments, the instructions further cause the oneor more processors to: detect an alteration in a state of the electronicdevice or an alteration in a state of the wireless communication, andreceive a video steam, which differs from the received video stream byat least one of: a resolution, picture quality, and a frame rate, fromthe first electronic device via the wireless communication circuit, thestatus information on the electronic device includes at least one of: atype of the electronic device, a size of the touchscreen, processingpower of the processor, a maximum resolution of the touchscreen, abattery status or level, memory status or capacity, or presence/absenceof a camera, and the status information on the communication includes avideo call quality level for performing a video call.

According to various embodiments, the electronic device further includesa camera. The instructions further cause the one or more processors to:adapt a video stream taken by the camera, based at least partly on thestatus information on the electronic device and the status informationon the wireless communication circuit, and transmit the adapted videostream to the first electronic device via the communication.

According to various embodiments, the instructions further cause the oneor more processors to: detect at least one of a face or an iris of theuser via the camera while receiving the video stream, and display thereceived video stream on the touchscreen only while at least one of aface or an iris of the user is detected.

According to various embodiments, the instructions further cause the oneor more processors to: display an indicator to adjust a quality of thereceived video stream, detect an input for adjusting the quality ofvideo stream via the indicator, determine an encoding schemecorresponding to the adjusted quality of video stream, transmit thedetermined encoding scheme to the first electronic device, receive avideo stream, adapted based on the encoding scheme, from the firstelectronic device, and display the received video stream.

According to various embodiments, the instructions further cause the oneor more processors to: set a region of interest (ROI) in the displayedvideo stream, transmit the ROI to the first electronic device, receive,from the first electronic device, a video stream, adapted based on atleast one of: focus, crop, change in picture quality, or exposureadjustment, with respect to the ROI, and display the received videostream.

According to various embodiments, the electronic device further includesat least one motion sensor. The instructions further cause the one ormore processors to: detect orientation of the electronic device usingthe sensor, while receiving the video stream, and display the receivedvideo stream on the touchscreen only while the detected orientation isin a selected range.

According to various embodiments, the instructions further cause the oneor more processors to: display the received video stream, receive a userinput for forwarding the video call, display at least one externaldisplay device to which the video call can be forwarded, receive a userselection of one of the at least one external display device, andforward the video call to the selected external display device.

According to various embodiments, the instructions further cause the oneor more processors to: analyze the status information on the electronicdevice and the status information on the wireless communication, anddisplay a selectable the user interface on the touchscreen, the userinterface is indicative of at least one operation related to the videocall, based on the analyzed status information on the electronic deviceand the analyzed status information on the wireless communication, theoperation is related to at least one of a quality of the video stream, avoice only call, a video call using a second electronic device, or avoice call using the second electronic device.

According to various embodiments, the instructions further cause the oneor more processors to: receive another video call request via the firstelectronic device from a third electronic device while performing thevideo call, detect an input for accepting the received video callrequest, further receive a video stream of the other video call via thefirst electronic device from the third electronic device, and display ascreen of the video call on a first region of the touchscreen, andanother screen of the other video call on a second region of thetouchscreen.

According to various embodiments, the electronic device further includesat least one motion sensor. The instructions further cause the one ormore processors to: detect an input pressing against the touchscreenwhile providing voice from the video call, using the speaker, determinea pressure level of the detected input, and perform an operation, basedat least partly on the detected pressure level.

According to various embodiments, the instructions further cause the oneor more processors to: detect a touch gesture input using thetouchscreen, while providing voice from the video call, using thespeaker, determine a direction of the input, and perform an operation,based at least partly on the detected direction.

According to various embodiments, the instructions further cause the oneor more processors to: detect an input via the touchscreen for storingat least a portion of the received video stream, and transmit, to thefirst electronic device, a request for storing, in the first electronicdevice, the at least a portion of the video stream, the request includesinformation on time when the input is detected.

According to various embodiments, the instructions further cause the oneor more processors to: detect a touch gesture input using thetouchscreen, while providing voice from the video call, using thespeaker, determine a direction of the input, and perform an operation,based at least partly on the detected direction.

According to various embodiments, the instructions further cause the oneor more processors to: detect an input via the touchscreen for storingat least a portion of the received video stream, and transmit, to thefirst electronic device, a request for storing, in the first electronicdevice, the at least a portion of the video stream, the request includesinformation on time when the input is detected.

According to various embodiments, the instructions further cause the oneor more processors to: receive, from the first electronic device,information on at least one electronic device capable of performing thevideo call, display an indication of the at least one electronic deviceon the touchscreen, receive a user input for selecting one of the atleast one electronic device, and transmit a signal for forwarding thevideo call to the selected electronic device to the first electronicdevice, using the wireless communication circuit.

According to various embodiments, the wireless communication circuitcomprises at least one of: a Bluetooth modem or Wi-Fi modem.

According to various embodiments, the electronic device is smartwatchand the first electronic device is a smartphone.

In various embodiments of the present disclosure, an electronic deviceis implemented to include: a first wireless communication circuitconfigured to communicate with a first electronic device, a secondwireless communication circuit configured to communicate with a secondelectronic device, a touchscreen configured to display a user interfaceto perform a video call, a speaker, a microphone, one or more processorselectrically connected to the first wireless communication circuit, asecond wireless communication circuit, the touchscreen, the speaker, andthe microphone, and a memory electrically connected to the one or moreprocessors. The memory stores instructions that, when executed, causethe one or more processors to: receive a video call request from thefirst electronic device via the first wireless communication circuit,display the received video call request on the touchscreen, create anotification based on the received video call request, transmit thecreated notification to the second electronic device via the secondwireless communication, receive a signal accepting the video callrequest from the second electronic device via the second wirelesscommunication circuit, stop displaying the video call request inresponse to the received signal accepting the video call request,receive and adapt a video stream from the first electronic device, basedat least partly on status information on the second electronic deviceand status information on the communication between the electronicdevice and the second electronic device, transmit the adapted videostream to the second electronic device via the second wirelesscommunication circuit, and transmit voice, received from the secondelectronic device via the second wireless communication circuit, to thefirst electronic device via the first wireless communication circuit.

According to various embodiments, the instructions further cause the oneor more processors to: receive, from the second electronic device, atleast one of a maximum resolution, a maximum level of picture quality,or a maximum frame rate (fps) of a video stream supported by the secondelectronic device, adapt at least one of a resolution, a level ofpicture quality, or a fps of the video stream within the at least one ofa maximum resolution, a maximum level of picture quality, or a maximumfps, based at least partly on the status information on thecommunication.

According to various embodiments, the instructions further cause the oneor more processors to: receive, from a third electronic device, a videocall forwarding request and information on the third electronic device,transmit video call connection information to the third electronicdevice, and transmit information on the third electronic device to thefirst electronic device via the first wireless communication circuit.

In various embodiments of the present disclosure, an electronic deviceis implemented to include: a first wireless communication circuitconfigured to communicate with a first electronic device, a touchscreenconfigured to display a user interface to perform a video call, aspeaker, a microphone, one or more processors electrically connected tothe first wireless communication circuit, the touchscreen, the speaker,and the microphone, and a memory electrically connected to the one ormore processors. The memory stores instructions that, when executed,cause the one or more processors to: transmit a video call requestsignal to the first electronic device via the first wirelesscommunication circuit, via the first wireless communication circuit,receive, from the first electronic device, a signal accepting the videocall request, status information on a second electronic device, andstatus information on communication between the first electronic deviceand the second electronic device, adapt a video stream, based at leastpartly on the received status information on the second electronicdevice and the received status information on the communication,transmit the adapted video stream to the first electronic device via thefirst wireless communication circuit, and receive a voice from the firstelectronic device.

Although it is not shown in FIG. 5, it should be understood that thefirst to third electronic devices are capable of further includingcomponents for added functions, e.g., a Global Positioning System (GPS)module for receiving location information, a broadcast receiving module,etc.

FIG. 6 is a signal flow diagram illustrating an example method for afirst electronic device to encode a video, while transmitting/receivingsignals to/from second and third electronic devices, according tovarious example embodiments of the present disclosure.

In various embodiments of the present disclosure, when the firstelectronic device 601 (e.g., the first electronic device 401 illustratedin FIG. 4) needs to make a video call with the third electronic device605 (e.g., the third electronic device 405 illustrated in FIG. 4) whichis connected to the second electronic device 603 (e.g., the secondelectronic device 403 illustrated in FIG. 4) via the second network(e.g., the second network 413 illustrated in FIG. 4), it is capable ofconverting video data for the video call into video data suitable forthe state of the third electronic device 605 or the state of the secondnetwork.

In various embodiments of the present disclosure, the first electronicdevice 601 may be identical or similar to part or the entire part of thefirst electronic device 401. The second electronic device 603 may beidentical or similar to part or the entire part of the second electronicdevice 403. The third electronic device 605 may be identical or similarto part or the entire part of the third electronic device 405.

With reference to FIG. 6, the first electronic device 601 is capable ofmaking a video call connection request to the second electronic device603 via the first network (e.g., the first network 411 illustrated inFIG. 4) in operation 611. The second electronic device 603 is capable oftransmitting, to the third electronic device 605 via the second network,a notification notifying that a video call connection request has beenreceived from the first electronic device 601 in operation 613. Thethird electronic device 605 accepts the video call connection requestand transmits the acceptance signal to the second electronic device 603in operation 615. The second electronic device 603 forwards the receivedvideo call connection acceptance signal to the first electronic device601 in operation 617.

In various embodiments of the present disclosure, the first electronicdevice 601 is capable of obtaining: status information regarding thesecond electronic device 603 from the second electronic device 603;status information regarding the third electronic device 605 connectedto the second electronic device 603 via the second network; and networkconnection information. The status information regarding the secondelectronic device 603 may contain at least one of the following: typeinformation, display size, processing power, supporting maximumresolution, battery status (e.g., battery level), memory status, andpresence/absence of a camera. The status information regarding the thirdelectronic device 605 may contain at least one of the following: typeinformation, display size, processing power, supporting maximumresolution, battery status (e.g., battery level), memory status, andpresence/absence of a camera. The network connection information maycontain status information regarding the first or second network.

In various embodiments of the present disclosure, the first electronicdevice 601 is capable of determining an encoding scheme, based on theobtained information, in operation 619. The first electronic device 601is capable of encoding (e.g., adapting) video data for performing avideo call, based on the determined encoding scheme, in operation 621,and transmitting the encoded (e.g., adapted) video data to the secondelectronic device 603 in operation 623.

In various embodiments of the present disclosure, the encoding schememay include a transcoding scheme, a scalable encoding scheme, or amirroring scheme. The first electronic device 601 is capable of encodingvideo data based on at least one of the transcoding scheme, the scalableencoding scheme, and the mirroring scheme. The second electronic device603 is capable of forwarding the encoded video data, received from thefirst electronic device 601, to the third electronic device 605 inoperation 625. The third electronic device 605 is capable of playingback the encoded video data, received from the second electronic device603, in operation 627.

The process of encoding video data via the transcoding scheme will bedescribed in detail later with reference to FIGS. 10 to 16.

The process of encoding video data via the scalable encoding scheme willbe described in greater detail below with reference to FIGS. 17A and17B.

The process of encoding video data via the mirroring scheme will bedescribed in detail later with reference to FIG. 18.

In various embodiments of the present disclosure, the third electronicdevice 605 is capable of receiving a voice using the microphone (e.g.,the microphone 563) in operation 629, and transmitting the voice signalto the second electronic device 603 in operation 631. The secondelectronic device 603 is capable of forwarding the received voice signalto the first electronic device 601 in operation 633.

In various embodiments of the present disclosure, when the thirdelectronic device 605 is configured to include a camera, it is capableof encoding videos taken by the camera, and transmitting the encodedvideo data along with a voice signal to the second electronic device603. For example, as described above referring to 4, the thirdelectronic device 605 may support a lower resolution than the firstelectronic device 601 and the second electronic device 603 do. When theresolution that the third electronic device 605 supports is lower thanthe resolution that the first electronic device 601 and the secondelectronic device 603 support, the third electronic device 605 iscapable of encoding video data transferred from the camera into videodata of low quality which can be reproduced with relatively low power.The third electronic device 605 is capable of transmitting the videodata encoded in low quality along with a voice signal to the secondelectronic device 603. It should be understood that the presentdisclosure is not limited to the embodiments. The third electronicdevice 605 may also encode video data transferred from the camera intoimages or an image sequence, and transmit, to the second electronicdevice 603, the images along with a voice signal or the image sequencealong with a voice signal.

FIG. 7 is a signal flow diagram illustrating an example method for afirst electronic device to encode a video, while transmitting/receivingsignals to/from second and third electronic devices, according tovarious example embodiments of the present disclosure.

In various embodiments of the present disclosure, when the firstelectronic device 701 (e.g., the first electronic device 401 illustratedin FIG. 4 or the first electronic device 601 illustrated in FIG. 6)needs to make a video call with the third electronic device 705 (e.g.,the third electronic device 405 illustrated in FIG. 4 or the thirdelectronic device 605 illustrated in FIG. 6) which is connected to thesecond electronic device 703 (e.g., the second electronic device 403illustrated in FIG. 4 or the second electronic device 603 illustrated inFIG. 6) via the second network (e.g., the second network 413), it iscapable of converting its video data for a video call into video datasuitable for the third electronic device 705, based on informationregarding the third electronic device 705 received from a server 711.

In various embodiments of the present disclosure, the server 711 iscapable of managing electronic devices capable of performing a videocall, based on user accounts. For example, the server 711 is capable ofmonitoring an electronic device registered based on a user account, andupdating status information regarding the electronic device, inreal-time, based on the monitoring result. That is, the server 711 iscapable of monitoring the electronic device and determining whether theelectronic device is possible to perform a video call, based on thestatus information regarding the electronic device. The statusinformation regarding the electronic device may include a stateindicating whether the electronic device is currently in use, a stateindicating whether the electronic device is turned on/off, a stateindicating whether the user is away from the electronic device, etc. Thefirst electronic device 701 is capable of selecting an electronic deviceto perform a video call from, e.g., a phonebook, based on the statusinformation regarding the electronic device updated by the server 711,and transmitting a video call request signal to the selected electronicdevice.

With reference to FIG. 7, the third electronic device 705 is capable oftransmitting a registration request to the second electronic device 703in operation 721. For example, the third electronic device 705 iscapable of requesting the second electronic device 703 to register thethird electronic device 705 as an electronic device capable ofperforming a video call in the server 711. When the second electronicdevice 703 receives a registration request from the third electronicdevice 705 in operation 721, it is capable of making an update requestto the server 711 in operation 723. For example, the second electronicdevice 703 is capable of requesting the server 711 to register or updateinformation regarding the third electronic device 705 therein. Theserver 711 is capable of requesting the first electronic device 701 toupdate information regarding the third electronic device 705, based onthe updated information regarding the third electronic device 705, inoperation 725.

In various embodiments of the present disclosure, the first electronicdevice 701 is capable of making a video call request to a specifiedelectronic device, based on information registered in the server 711,e.g., information regarding electronic devices capable of performing avideo call. For example, the first electronic device 701 is capable ofupdating information regarding the second electronic device 703 or thethird electronic device 705, received from the server 711, andidentifying an electronic device capable of performing a video call,e.g., the third electronic device 705, based on the updated information.The server 711 is capable of obtaining, from the second electronicdevice 703, and storing at least one of the following: type informationregarding the second electronic device 703 and the third electronicdevice 705, display size, processing power, maximum resolution that thethird electronic device 705 supports, battery status (e.g., batterylevel), memory status, presence/absence of a camera, status informationregarding the first network (e.g., the first network 411 illustrated inFIG. 4), and status information regarding the second network.

The first electronic device 701 is capable of determining the thirdelectronic device 705 as an electronic device capable of performing avideo call, and making a video call connection request to the secondelectronic device 703 via the first network in operation 727. The secondelectronic device 703 is capable of transmitting, to the thirdelectronic device 705 via the second network, a notification notifyingthat a video call connection request has been received from the firstelectronic device 701 in operation 729. The third electronic device 705accepts the video call connection request and transmits the acceptancesignal to the second electronic device 703 in operation 731. The secondelectronic device 703 forwards the received video call connectionacceptance signal to the first electronic device 701 in operation 733.

The first electronic device 701 is capable of determining an encodingscheme, based on information regarding the second electronic device 703,information regarding the third electronic device 705 connected to thesecond electronic device 703, and network connection information, storedin the server 711, in operation 735. The first electronic device 701 iscapable of encoding video data for performing a video call, based on thedetermined encoding scheme, in operation 737, and transmitting theencoded video data to the second electronic device 703 in operation 739.The second electronic device 703 is capable of forwarding the encodedvideo data, received from the first electronic device 701, to the thirdelectronic device 705 in operation 741. The third electronic device 705is capable of playing back the encoded video data, received from thesecond electronic device 703, in operation 743.

In various embodiments of the present disclosure, the third electronicdevice 705 is capable of receiving a voice using the microphone (e.g.,the microphone 563) in operation 745, and transmitting the voice signalto the second electronic device 703 in operation 747. The secondelectronic device 703 is capable of forwarding the received voice signalto the first electronic device 701 in operation 749.

FIG. 8 is a signal flow diagram illustrating an example method for afirst electronic device to encode a video, while transmitting/receivingsignals to/from second and third electronic devices, according tovarious example embodiments of the present disclosure.

With reference to FIG. 8, the first electronic device 801 (e.g., thefirst electronic device 401 illustrated in FIG. 4, the first electronicdevice 601 illustrated in FIG. 6, or the first electronic device 701illustrated in FIG. 7) is capable of making a video call connectionrequest to a second electronic device 803 (e.g., the second electronicdevice 403 illustrated in FIG. 4, the second electronic device 603illustrated in FIG. 6, or the second electronic device 703 illustratedin FIG. 7) via the first network (e.g., the first network 411illustrated in FIG. 4) in operation 811. The second electronic device803 is capable of transmitting, to the third electronic device 805 viathe second network (e.g., the second network 413 illustrated in FIG. 4),a notification notifying that a video call connection request has beenreceived from the first electronic device 801 in operation 813. Thethird electronic device 805 accepts the video call connection requestand transmits the acceptance signal to the second electronic device 803in operation 815.

In various embodiments of the present disclosure, the third electronicdevice 805 is capable of transmitting video data of the third electronicdevice 805 along with the acceptance signal to the second electronicdevice 803 in operation 815.

In various embodiments of the present disclosure, the third electronicdevice 805 may be equipped with a camera. In this case, the thirdelectronic device 805 is capable of transmitting video data obtained viathe camera to the second electronic device 803. For example, the thirdelectronic device 805 is capable of encoding the obtained video databased on its status information and status information regarding thesecond network. The third electronic device 805 is capable oftransmitting the encoded video data to the second electronic device 803.

In various embodiments of the present disclosure, the second electronicdevice 803 is capable of forwarding the acceptance signal and theencoded video data, received from the third electronic device 805, tothe first electronic device 801 in operation 817. Alternatively, thethird electronic device 805 is capable of only creating a voice signaland transmitting the voice signal to the second electronic device 803.

The first electronic device 801 is capable of detecting the quality ofvideo data encoded by the third electronic device 805, received from thesecond electronic device 803, in operation 819. For example, the firstelectronic device 801 is capable of detecting the received, encodedvideo data, in terms of the encoding scheme, the quality, or the size.

The first electronic device 801 is capable of determining an encodingscheme for video data to be transmitted, based on the detected videoscheme, quality, or size, of the video data received from the thirdelectronic device 805 in operation 821. It should be understood that thedetermination of an encoding scheme for video data to be transmitted isnot limited to only information related to the video data listed above.That is, the first electronic device 801 is also capable of determiningan encoding scheme for video data, using display size and processingpower of the third electronic device 805, maximum resolution that thethird electronic device 805 supports, battery status (e.g., batterylevel), memory status, presence/absence of a camera, status informationregarding the first network, and status information regarding the secondnetwork, received from the second electronic device 803, as well asvideo data of the third electronic device 805, in operation 821.

The first electronic device 801 is capable of encoding video data, basedon the determined encoding scheme, in operation 823, and transmittingthe encoded video data to the second electronic device 803 in operation825. The second electronic device 803 is capable of forwarding theencoded video data, received from the first electronic device 801, tothe third electronic device 805 in operation 827. The third electronicdevice 805 is capable of playing back the encoded video data, receivedfrom the second electronic device 803, in operation 829. The thirdelectronic device 805 is capable of receiving a voice using themicrophone (e.g., the microphone 563) in operation 831, and transmittingthe voice signal to the second electronic device 803 in operation 833.The second electronic device 803 is capable of forwarding the receivedvoice signal to the first electronic device 801 in operation 835.

FIG. 9 is a signal flow diagram illustrating an example method for asecond electronic device to encode a video, while transmitting/receivingsignals to/from first and third electronic devices, according to variousexample embodiments of the present disclosure.

In various embodiments of the present disclosure, when the secondelectronic device 903 (e.g., the second electronic device 403illustrated in FIG. 4, the second electronic device 603 illustrated inFIG. 6, the second electronic device 703 illustrated in FIG. 7, or thesecond electronic device 803 illustrated in FIG. 8) needs to make avideo call with the third electronic device 905 (e.g., the thirdelectronic device 405 illustrated in FIG. 4, the third electronic device605 illustrated in FIG. 6, the third electronic device 705 illustratedin FIG. 7, or the third electronic device 805 illustrated in FIG. 8)which is connected to the second electronic device 903 and the firstelectronic device 901 (e.g., the first electronic device 401 illustratedin FIG. 4, the first electronic device 601 illustrated in FIG. 6, thefirst electronic device 701 illustrated in FIG. 7 or the firstelectronic device 801 illustrated in FIG. 8), via the second network(e.g., the second network 413 illustrated in FIG. 4), it is capable ofconverting video data for performing a video call into video datasuitable for the third electronic device 905.

With reference to FIG. 9, the first electronic device 901 is capable ofmaking a video call connection request to the second electronic device903 via the first network (e.g., the first network 411 illustrated inFIG. 4) in operation 911. The second electronic device 903 is capable oftransmitting, to the third electronic device 905 via the second network,a notification notifying that a video call connection request has beenreceived from the first electronic device 901 in operation 913. Thethird electronic device 905 accepts the video call connection requestand transmits the acceptance signal to the second electronic device 903in operation 915. The second electronic device 903 forwards the receivedvideo call connection acceptance signal to the first electronic device901 in operation 917.

In various embodiments of the present disclosure, the first electronicdevice 901 is capable of transmitting video data for video call,obtained via the camera, to the second electronic device 903 inoperation 919. The second electronic device 903 is capable ofdetermining an encoding scheme for encoding video data received from thefirst electronic device 901, based on status information regarding thethird electronic device 905 (e.g., type, screen size, processing power,maximum resolution, battery status, memory status, presence/absence of acamera, etc. of the third electronic device 905), status informationregarding the first network, status information regarding the secondnetwork, in operation 921. The second electronic device 903 is capableof encoding video data for performing a video call based on thedetermined encoding scheme in operation 923, and transmitting theencoded video data to the third electronic device 905 in operation 925.The third electronic device 905 is capable of playing back the receivedvideo data in operation 927. When the third electronic device 905receives a voice using the microphone (e.g., the microphone 563) inoperation 929, it is capable of transmitting the voice signal to thesecond electronic device 903 in operation 931. The second electronicdevice 903 is capable of forwarding the received voice signal to thefirst electronic device 901 in operation 933.

FIG. 10 is a diagram illustrating an example method of encoding videodata in a first electronic device according to various exampleembodiments of the present disclosure;

In various embodiments of the present disclosure, the first electronicdevice (e.g., the first electronic device 401 illustrated in FIG. 4, thefirst electronic device 601 illustrated in FIG. 6, the first electronicdevice 701 illustrated in FIG. 7, the first electronic device 801illustrated in FIG. 8 or the first electronic device 901 illustrated inFIG. 9) or the second electronic device (e.g., the second electronicdevice 403 illustrated in FIG. 4, the second electronic device 603illustrated in FIG. 6, the second electronic device 703 illustrated inFIG. 7, the second electronic device 803 illustrated in FIG. 8 or thesecond electronic device 903 illustrated in FIG. 9) is capable ofconverting video data of the first electronic device into video callsuitable for the third electronic device (e.g., the third electronicdevice 405 illustrated in FIG. 4, the third electronic device 605illustrated in FIG. 6, the third electronic device 705 illustrated inFIG. 7, the third electronic device 805 illustrated in FIG. 8 or thethird electronic device 905 illustrated in FIG. 9) using a transcodingscheme.

Although the embodiment of FIG. 10 is described assuming that the firstelectronic device encodes video data, it should be understood that thepresent disclosure is not limited to the embodiment. The video dataencoding method may also be applied to the second electronic device inthe same way as the first electronic device.

In various embodiments of the present disclosure, the first or secondelectronic device is suitable for playback of video data which has aresolution of Full HD (1920×1080) or HD (1280×720) and a frame rate of30 frames per second (fps). The third electronic device is suitable forplayback of video data which has a resolution of QVGA (320×204), CIF(352×288), or QCIF (176×240) and a frame rate of 15 or 30 fps, withoutthe degradation of picture quality. Since the third electronic devicehas a smaller screen size and a lower resolution than the first orsecond electronic device does, it does not need to play back video datain the same resolution of Full HD (1920×1080) or HD (1280×720) and atthe frame rate of 30 fps as the first or second electronic device does.When the second and third electronic devices are connected to each othervia the second network (e.g., the second network 413 illustrated in FIG.4), e.g., a low-power network such as Bluetooth or Wi-Fi network, thesecond electronic device has difficulty in securing a transfer rate forstreaming a large size file to the third electronic device, and thethird electronic device consumes a large amount of battery power whenstreaming and playing video data of high picture quality, which depletesits battery level.

In an embodiment, the third electronic device is capable of playing backvideo data which has a resolution of QVGA (320×204), CIF (352×288), orQCIF (176×240) and a frame rate of 15 or 30 fps, on its relatively smallsize screen, efficiently, without the degradation of picture quality.Since the third electronic device has a relatively small size screenplaying back video data, the user may have difficulty in finding thedegradation of picture quality which is caused as video data iscompressed at a relatively high compression ratio. In order to resolvethe problem, various embodiments of the present disclosure are capableof reducing a file size of video stream and thus decreasing a bandwidthrequired for streaming. Therefore, various embodiments have advantagesin an environment where the network quality is low or a network whosebandwidth is used for low-power connection.

In various embodiments of the present disclosure, a transcoding schemeparameter is used to convert video data of the first electronic deviceinto video data suitable for the third electronic device using atranscoding scheme. The transcoding scheme parameter may include picturequality (a compression ratio), fps (the number of frames per second),resolution (resize), focus, or crop.

In various embodiments of the present disclosure, the first electronicdevice is capable of determining a transcoding scheme parameter used forthe encoding, based on: information regarding the third electronicdevice (e.g., a type of the third electronic device, display size,presence/absence of a camera, processing power, supporting codec,current battery level, memory usage, the number of applications in use,or a type of application), connected to the second electronic device viathe second network, or the second electronic device; information(state/signal quality) regarding the first network (e.g., the firstnetwork 411 illustrated in FIG. 4) connecting the first and secondelectronic devices; and information (state/signal quality) regarding thesecond network connecting the second and third electronic devices.

With reference to FIG. 10, the first electronic device is capable ofdetecting a maximum frame rate (fps), a maximum level of picturequality, or a maximum resolution of video data, which may be required bythe third electronic device, in operation 1001.

The first electronic device is capable of determining an availabletransfer rate (bit rate), based on a network state in operation 1003.The network state may include information (state/signal quality)regarding the first network connecting the first and second electronicdevices and information (state/signal quality) regarding the secondnetwork connecting the second and third electronic devices.

In various embodiments of the present disclosure, the first electronicdevice is capable of determining I-frame refresh, picture quality, framerate (fps), and resolution, corresponding to the determined transferrate (bit rate). More specifically, the first electronic device iscapable of determining a resolution for video data corresponding to thetransfer rate (bit rate) in operation 1005, and resizing the video databased on the determined resolution in operation 1007. The firstelectronic device is capable of determining a frame rate (fps) for videodata, corresponding to the transfer rate (bit rate) in operation 1009,and altering a frame rate for the video data, based on the determinedframe rate in operation 1011. The first electronic device is capable ofdetermining a level of picture quality (compression ratio) for videodata corresponding to the transfer rate (bit rate) in operation 1013,and altering a compression ratio of the video data, based on thedetermined picture quality (compression ratio) in operation 1015. Thefirst electronic device is capable of determining I-frame refresh forvideo data, corresponding to the transfer rate (bit rate) in operation1017.

In various embodiments of the present disclosure, the first electronicdevice is capable of encoding video data, based on the alteredresolution, the altered frame rate (fps), the altered picture quality,or the altered I-frame refresh in operation 1019. The first electronicdevice is capable of transmitting the encoded video data to the secondelectronic device via the first network in operation 1021.

FIG. 11 is a diagram illustrating an example method of encoding videodata in a first electronic device according to various embodiments ofthe present disclosure.

With reference to FIG. 11, the first electronic device (e.g., the firstelectronic device 401 illustrated in FIG. 4, the first electronic device601 illustrated in FIG. 6, the first electronic device 701 illustratedin FIG. 7, the first electronic device 801 illustrated in FIG. 8, or thefirst electronic device 901 illustrated in FIG. 9) is capable ofincluding a network interface 1101, a video call client 1103, a networkmanager 1105, a video call manager 1107, an image processor 1109, acamera sensor 1111, a captured image processing unit 1113, a cameradriver 1115, an encoder driver 1117, an encoder 1119, and a memory 1121.

With reference to FIG. 11, reference number 1131 represents the flow ofa control signal and reference number 1133 represents the flow of avideo call signal from the first electronic device to the secondelectronic device 1123 (e.g., the second electronic device 403illustrated in FIG. 4, the second electronic device 603 illustrated inFIG. 6, the second electronic device 703 illustrated in FIG. 7, thesecond electronic device 803 illustrated in FIG. 8, or the secondelectronic device 903 illustrated in FIG. 9).

In various embodiments of the present disclosure, the network manager1105 is capable of performing network connection management operations,e.g., connection establishment, connection monitoring, connectionadjustments, connection tear down, etc. The network manager 1105 iscapable of creating packets from data to be transmitted, to comply withthe network environment, and de-packeting and recovering receivedpackets to corresponding signals. The network manager 1105 is capable ofmeasuring the network quality, using feedback data, such as packet lossinformation, round trip delay, etc. The network manager 1105 is alsocapable of measuring the network quality via training sequences receivedat a certain interval from the third electronic device (e.g., the thirdelectronic device 405 illustrated in FIG. 4, the third electronic device605 illustrated in FIG. 6, the third electronic device 705 illustratedin FIG. 7, the third electronic device 805 illustrated in FIG. 8, or thethird electronic device 905 illustrated in FIG. 9). The network manager1105 transfers the measured network quality to the video call manager1107.

In various embodiments of the present disclosure, the video call client1103 is an application for performing a video call. When the video callclient 1103 detects a user input for a video call, it is capable oftransferring the user input signal to the video call manager 1107.

The video call manager 1107 is a module for controlling video call. Thevideo call manager 1107 is capable of controlling the network manager1105, the encoder driver 1117, etc. to provide video call services. Thevideo call manager 1107 is capable of controlling functions forperforming a video call, based on user inputs received from the videocall client 1103. The video call manager 1107 is capable of loadinginformation regarding the third electronic device from the memory 1121and performing a video call based on the loaded information. Forexample, the video call manager 1107 is capable of controlling thequality of video data required for a video call, based on part of theinformation regarding the third electronic device stored in the memory1121.

In order to perform a video call with the third electronic device, thevideo call manager 1107 is capable of determining a required transferrate (e.g., a maximum bit rate), based on the attributes of the thirdelectronic device obtained from the network manager 1105, the memory1121, and the video call client 1103. The video call manager 1107 iscapable of detecting a network state of the second network (e.g., thesecond network 413 illustrated in FIG. 4) via the network manager 1105,and determining a transfer rate (bit rate) based on the network state.The video call manager 1107 is capable of determining: a resolution,frame rate (fps) or picture quality corresponding to the determinedtransfer rate (bit rate); and an encoding scheme for encoding video datain the encoder 1119, based on the determined resolution, frame rate(fps) or picture quality.

In various embodiments of the present disclosure, the video call manager1107 is capable of controlling a vertical blanking interval (VBI) signalfor the camera sensor 1111. The video call manager 1107 is capable ofadjusting a frame rate in such a way that it controls a VBI of thecamera sensor 1111 to drop frames of the video data input via the camerasensor 1111. For example, when the frame rate of video data received viathe camera sensor 1111 is 30 fps, the video call manager 1107 adjuststhe frame rate from 30 fps to 15 fps, by dropping frames of the videodata.

In various embodiments of the present disclosure, the network manager1105 is capable of adjusting a frame rate of video data which is beingencoded, by controlling a buffer to drop frames. The network manager1105 is capable of adjusting a frame rate of received, encoded videodata, by dropping the frames of the video data. For example, when thenetwork manager 1105 receives encoded video data at a frame rate of 30fps, it is capable of adjusting the frame rate to 15 fps, by droppingframes of the received video data.

In various embodiments of the present disclosure, the camera sensor 1111is capable of obtaining and transferring video data to the capturedimage processing unit 1113. The captured image processing unit 1113 iscapable of transferring the received video data to the image processor1109 via the camera driver 1115.

In various embodiments of the present disclosure, the camera sensor 1111is capable of obtaining video data during a certain interval andtransmitting the obtained video data to the image processor 1109 via thecamera driver 1115.

In various embodiments of the present disclosure, the image processor1109 is capable of adjusting the size and the picture quality of videodata. The image processor 1109 is capable of adjusting: the size ofvideo data by cropping a screen; and the picture quality of video data,such as the reduction of image, the alteration in quantization level ofimage, etc., corresponding to the display ratio of the third electronicdevice. For example, the image processor 1109: recognizes a user's faceor an object from video data, determines a region of interest (ROI); andcrops the image of the video data to comply with the attribute of thethird electronic device, based on the ROI.

Alternatively, the image processor 1109 is capable of applying differentencoding schemes to the ROI and the other region, or a non-ROI, based onthe ROI. That is, various embodiments of the present disclosure arecapable of providing ROI with higher quality video for ROI than theother region (or non-ROI). More specifically, ROI is displayed in higherquality of video than non-ROI. The image processor 1109 is capable oftransferring the video data, adjusted in picture quality and size, tothe encoder 1119 via the encoder driver 1117.

In various embodiments of the present disclosure, the encoder 1119 iscapable of encoding the received adjusted video data, based on theencoding scheme, and transmitting the encoded video data to the secondelectronic device via the network manager 1105 and the network interface1101.

In various embodiments of the present disclosure, the memory 1121 isimplemented with volatile or non-volatile storage. The memory 1121 iscapable of storing information regarding one or more electronic devices,e.g., wearable devices. The memory 1121 is also capable of storingvarious information regarding one or more electronic devices, such as atype of electronic device, a display size, a battery capacity (level),etc. The various information regarding one or more electronic devicesmay be used when the video call manager 1107 controls a video call. Theinformation regarding electronic devices may be obtained when the firstor second electronic device discovers connectable devices or from ahistory of stored connection information. The information regardingelectronic devices may contain information registered in themanufacturing process.

FIG. 12 is a diagram illustrating an example method of reproducingencoded video data in a third electronic device according to variousexample embodiments of the present disclosure.

In various embodiments of the present disclosure, the third electronicdevice 405 is capable of playing back the encoded video data receivedfrom the second electronic device 403.

With reference to FIG. 12, third electronic device (e.g., the thirdelectronic device 405 illustrated in FIG. 4, the third electronic device605 illustrated in FIG. 6, the third electronic device 705 illustratedin FIG. 7, the third electronic device 805 illustrated in FIG. 8, or thethird electronic device 905 illustrated in FIG. 9) is capable ofincluding a network interface 1201 (e.g., the network interface 1101illustrated in FIG. 11), a network manager 1203 (e.g., the networkmanager 1105 illustrated in FIG. 11), a decoder driver 1205, a decoder1207, a video call client 1209 (e.g., the video call client 1103illustrated in FIG. 11), and a video call manager 1211 (e.g., the videocall manager 1107 illustrated in FIG. 11).

In various embodiments of the present disclosure, reference number 12211131 represents the flow of a control signal and reference number 1223represents the flow of signals for receiving and playing back encodedvideo data from the second electronic device (e.g., the secondelectronic device 403 illustrated in FIG. 4, the second electronicdevice 603 illustrated in FIG. 6, the second electronic device 703illustrated in FIG. 7, the second electronic device 803 illustrated inFIG. 8, the second electronic device 903 illustrated in FIG. 9, or thesecond electronic device 1123 illustrated in FIG. 11).

In various embodiments of the present disclosure, the third electronicdevice is capable of receiving video data optimized for the thirdelectronic device, from the second electronic device via the networkmanager 1203. The decoder driver 1205 and the decoder 1207 transfers thereceived video data to the video call client 1209, thereby playing backthe video data. The third electronic device is capable of transmittingits information or network quality-related status information regardingthe second electronic device, via the network manager 1203. In variousembodiments of the present disclosure, the third electronic device iscapable of transmitting, to the second electronic device, networkquality-related status information regarding its nearby other electronicdevices and information regarding the nearby electronic devices.

In various embodiments of the present disclosure, the third electronicdevice is capable of: determining a transcoding scheme parameter. Thethird electronic device is capable of transmitting the determinedparameter to the first electronic device (e.g., the first electronicdevice 401 illustrated in FIG. 4, the first electronic device 601illustrated in FIG. 6, the first electronic device 701 illustrated inFIG. 7, the first electronic device 801 illustrated in FIG. 8, or thefirst electronic device 901 illustrated in FIG. 9) or the secondelectronic device; and requesting to encode the video data. The first orsecond electronic device is capable of encoding video data based on theparameter, in response to the encoding request received from the thirdelectronic device, and transmitting the encoded video data to the thirdelectronic device.

FIG. 13 is a diagram illustrating an example method of encoding videodata in a second electronic device according to various embodiments ofthe present disclosure.

With reference to FIG. 13, the second electronic device (e.g., thesecond electronic device 403 illustrated in FIG. 4, the secondelectronic device 603 illustrated in FIG. 6, the second electronicdevice 703 illustrated in FIG. 7, the second electronic device 803illustrated in FIG. 8, the second electronic device 903 illustrated inFIG. 9, the second electronic device 1123 illustrated in FIG. 11, or thesecond electronic device 1215 illustrated in FIG. 12) is capable ofincluding a network interface 1301 (e.g., the network interface 1101illustrated in FIG. 11, or the network interface 1201 illustrated inFIG. 12), a network manager 1303 (e.g., the network manager 1105illustrated in FIG. 11, or the network manager 1203 illustrated in FIG.12), a transcoder driver 1305, an encoder/decoder 1307, a video callmanager 1309 (e.g., the video call manager 1107 illustrated in FIG. 11or the video call manager 1211 illustrated in FIG. 12), a video callclient 1311 (e.g., the video call client 1103 illustrated in FIG. 11 orthe video call client 1209 illustrated in FIG. 12), and a memory 1313(e.g., the memory 1121 illustrated in FIG. 11).

In various embodiments of the present disclosure, reference number 1321represents the flow of a control signal. Reference number 1323represents the flow of a signal from the first electronic device 1315(e.g., the first electronic device 401 illustrated in FIG. 4, the firstelectronic device 601 illustrated in FIG. 6, the first electronic device701 illustrated in FIG. 7, the first electronic device 801 illustratedin FIG. 8, or the first electronic device 901 illustrated in FIG. 9) tothe second electronic device. Reference number 1325 represents the flowof a signal from the second electronic device to the third electronicdevice 1317 (e.g., the third electronic device 405 illustrated in FIG.4, the third electronic device 605 illustrated in FIG. 6, the thirdelectronic device 705 illustrated in FIG. 7, the third electronic device805 illustrated in FIG. 8, or the third electronic device 905illustrated in FIG. 9).

In various embodiments of the present disclosure, since the networkinterface 1301, network manager 1303, video call manager 1309, videocall client 1311, and memory 1311 are identical to the network interface1101, network manager 1105, video call client 1103, video call manager1107, and memory 1121 which are described above referring to FIG. 11,their detailed description will be omitted below.

In various embodiments of the present disclosure, the video call client1311 is an application for performing a video call. The video callclient 1311 is capable of detecting inputs for selecting an electronicdevice in order to perform a video call and adjusting the quality ofvideo data.

In various embodiments of the present disclosure, the network manager1303 is capable of performing network connection management operations,e.g., connection establishment, connection monitoring, connectionadjustments, connection tear down, etc. The network manager 1303 iscapable of measuring the network quality, using feedback data, such aspacket loss information, round trip delay, etc. The network manager 1303is also capable of measuring the network quality via training sequencesreceived at a certain interval from the third electronic device 1317.The network manager 1303 is capable of transferring the measured networkquality to the video call manager 1311.

In various embodiments of the present disclosure, the transcoder driver1305 is capable of: determining the picture quality, frame rate (fps) orresolution of video data, using the encoding parameter that the videocall manager 1311 determined based on encoding criterions (e.g.,attribute information regarding the second electronic device and thethird electronic device 1317, status information regarding the firstnetwork (e.g., the first network 411 illustrated in FIG. 4), or statusinformation regarding the second network (e.g., the second network 413illustrated in FIG. 4); and converting the video data into video datasuitable for the third electronic device 1317, based on the determinedpicture quality, frame rate (fps) or resolution of video data.

In various embodiments of the present disclosure, the memory 1313 iscapable of storing information regarding one or more electronic devices,e.g., a type of electronic device, a display size, a battery capacity,etc.

The video call manager 1309 is a module for controlling video call. Thevideo call manager 1309 is capable of controlling the network manager1303, the encoder/decoder driver 1307, etc. to provide video callservices. The video call manager 1311 is capable of controllingfunctions for performing a video call, based on user inputs receivedfrom the video call client 1311. The video call manager 1309 is capableof loading information regarding the third electronic device 1317, e.g.,wearable device, from the memory 1313, performing a video call, andcontrolling the quality of video data.

The video call manager 1309 is capable of determining a requiredtransfer rate (maximum bit rate) based on the attributes of the thirdelectronic device 1317 in order to perform a video call using video dataobtained from the network manager 1303, the memory 1313, and the videocall client 1311. The video call manager 1309 is capable of estimating aquality level of the second network connecting the third electronicdevice 1317 and the second electronic device, from the network manager1303, and determining an available transfer rate (bit rate), based onthe estimated quality level. The video call manager 1309 is capable ofdetermining: the picture quality, frame rate (fps) or resolutioncorresponding to the determined transfer rate (bit rate); and anencoding scheme for encoding video data, based on the determined picturequality, frame rate (fps) or resolution.

In various embodiments of the present disclosure, the video call manager1309 is capable of adjusting the size and the picture quality of videodata, via an image processor of the transcoder driver 1305. The imageprocessor is capable of reducing to the size in screen for video data toa certain ration or adjusting the picture quality of video data byaltering the quantization level. Alternatively, the image processor:crops a screen of video data to adjust the size; recognizes a user'sface or an object to set a region of interest (ROI); and crops the ROI,complying with the attribute of the third electronic device 1317, e.g.,the display size.

For example, it is assumed that the first electronic device 1315 has atouchscreen whose height is larger than the width and the thirdelectronic device 1317 has a touchscreen whose height and width areidentical to each other, i.e., a square. In this case, the imageprocessor of the first electronic device 1315 sets an ROI (e.g., face),as a portrait shape, in a video, crops the set ROI from the video, andtransmits the cropped video data to the third electronic device 1317.When the second electronic device does not detect or track the ROI fromthe video data, it may crop the center portion from the video data andtransmit the center-cropped video data to the third electronic device1317 or may transmit the video data without performing the croppingoperation to the third electronic device 1317.

In various embodiments of the present disclosure, the ROI may be set,based on a graphic tool for a rectangle, a circle, etc., a closed loop,a touch input, a duration of a touch input, etc.

In various embodiments of the present disclosure, the second electronicdevice is capable of encoding the set ROI with different levels ofquality. For example, when a user's face is set as an ROI, the imageprocessor of the second electronic device adjusts quantization levels onthe face and its neighboring part in such a way as to create: video dataof high picture quality for the ROI; and video data of low picturequality for the non-ROI.

In various embodiments of the present disclosure, the second electronicdevice is capable of receiving an ROI selected by the third electronicdevice 1317.

In various embodiments of the present disclosure, one or more ROIs maybe set. The ROI may be altered during a video call.

FIG. 14A is a diagram illustrating an example method of encoding videodata in a second electronic device according to various embodiments ofthe present disclosure.

In various embodiments of the present disclosure, the second electronicdevice (e.g., the second electronic device 403 illustrated in FIG. 4,the second electronic device 603 illustrated in FIG. 6, the secondelectronic device 703 illustrated in FIG. 7, the second electronicdevice 803 illustrated in FIG. 8, the second electronic device 903illustrated in FIG. 9, the second electronic device 1123 illustrated inFIG. 11, or the second electronic device 1215 illustrated in FIG. 12) iscapable of converting video data, e.g., video stream, received from thefirst electronic device 1401 (e.g., the first electronic device 401illustrated in FIG. 4, the first electronic device 601 illustrated inFIG. 6, the first electronic device 701 illustrated in FIG. 7, the firstelectronic device 801 illustrated in FIG. 8, or the first electronicdevice 901 illustrated in FIG. 9), into analogue audio signals anddigital still images and transmitting the analogue audio signals anddigital still images to the third electronic device 1413 (e.g., thethird electronic device 405 illustrated in FIG. 4, the third electronicdevice 605 illustrated in FIG. 6, the third electronic device 705illustrated in FIG. 7, the third electronic device 805 illustrated inFIG. 8, or the third electronic device 905 illustrated in FIG. 9). Forexample, the third electronic device 1413 is capable of: continuouslyoutputting audio signals received from the second electronic device; andoutputting video signals, asynchronous with the audio signals. Forexample, when the quality of the second network (e.g., the secondnetwork 413 illustrated in FIG. 4) connecting the second electronicdevice and the third electronic device 1413 is a relatively low level orthe battery level of the third electronic device 1413 is relatively low,the third electronic device 1413 outputs: audio signals in a continuousmanner; and video signals in a manner asynchronous with the audiosignals, thereby maintaining the video call service with a minimum ofresources.

With reference to FIG. 14A, reference number 1421 represents the flow ofa control signal. Reference number 1423 represents the flow of a videocall signal from the first electronic device 1401 to the secondelectronic device. Reference number 1425 represents the flow of signalstransmitting encoded video data from the second electronic device to thethird electronic device 1413.

In various embodiments of the present disclosure, after the encodingprocess is performed, the decoder 1407 is capable of processing thevideo data process via a post process 1406. For example, the postprocess 1406 is capable of creating a still image based on the videodata decoded by the decoder 1407. The decoder 1407 is capable ofseparating the video data received from the decoder driver 1405 into avoice signal and a video signal and decoding the separated signals. Thedecoder 1407 is capable of transmitting the decoded voice signal to thethird electronic device 1413 via a channel separated by the networkmanager 1403. The decoder 1407 is capable of transferring the decodedvideo signal to the post process 1406. The post process 1406 is capableof converting the video signal into a still image, and transmitting thestill image to the third electronic device 1413, via the decoder driver1405 and the network manager 1403 (e.g., the network manager 1105illustrated in FIG. 11, the network manager 1203 illustrated in FIG. 12,or the network manager 1303 illustrated in FIG. 13).

The post process 1406 is described in detail as follows, with referenceto FIG. 14B.

FIG. 14B is a diagram illustrating an example post process according tovarious embodiments of the present disclosure.

With reference to FIG. 14B, the post process 1406 is capable ofincluding an intra-frame (I-frame) extractor 1415, a comparator 1417,and an image creator 1419.

In various embodiments of the present disclosure, reference number 1421represents the flow of a control signal. Reference number 1423represents the flow of a video call signal from the first electronicdevice (e.g., the first electronic device 401 illustrated in FIG. 4, thefirst electronic device 601 illustrated in FIG. 6, the first electronicdevice 701 illustrated in FIG. 7, the first electronic device 801illustrated in FIG. 8, the first electronic device 901 illustrated inFIG. 9, or the first electronic device 1401 illustrated in FIG. 14A) tothe second electronic device (e.g., the second electronic device 403illustrated in FIG. 4, the second electronic device 603 illustrated inFIG. 6, the second electronic device 703 illustrated in FIG. 7, thesecond electronic device 803 illustrated in FIG. 8, the secondelectronic device 903 illustrated in FIG. 9, the second electronicdevice 1123 illustrated in FIG. 11, or the second electronic device 1215illustrated in FIG. 12). Reference number 1425 represents the flow ofsignals transmitting encoded video data from the second electronicdevice to the third electronic device (e.g., the third electronic device405 illustrated in FIG. 4, the third electronic device 605 illustratedin FIG. 6, the third electronic device 705 illustrated in FIG. 7, thethird electronic device 805 illustrated in FIG. 8, the third electronicdevice 905 illustrated in FIG. 9, or the third electronic device 1413illustrated in FIG. 14A).

In various embodiments of the present disclosure, the I-frame extractor1415, the comparator 1417, and the image creator 1419 are capable oftransmitting/receiving control signals to/from the video call manager1409. The I-frame extractor 1415 is capable of: receiving video datadecoded by the decoder 1407; extracting an I-frame from the receivedvideo data; and transferring the I-frame to the comparator 1417.

The comparator 1417 is capable of comparing a previous I-frame, e.g., afirst I-frame, with a current I-framed, e.g., a second I-frame, in termsof similarity. The comparator 1417 is capable of determining a degree ofsimilarity, based on criterions received from the video call manager1409, and adjusting the number of images to be created from the videodata, based on the determined similarity. For example, when thecomparator 1417 ascertains that the similarity exceeds criterions, it iscapable of transferring the second I-frame to the image creator 1419.The image creator 1419 is capable of creating a still image based on thesecond I-frame. The image creator 1419 is capable of transmitting thecreated still image to the third electronic device via the networkmanager 1403.

FIG. 15 is a diagram illustrating an example method of encoding videodata in a second electronic device according to various exampleembodiments of the present disclosure.

With reference to FIG. 15, reference number 1551 represents the flow ofa control signal. Reference number 1553 represents the flow of a videocall signal from the first electronic device (e.g., the first electronicdevice 401 illustrated in FIG. 4, the first electronic device 601illustrated in FIG. 6, the first electronic device 701 illustrated inFIG. 7, the first electronic device 801 illustrated in FIG. 8, the firstelectronic device 901 illustrated in FIG. 9, or the first electronicdevice 1401 illustrated in FIG. 14A) to the second electronic device(e.g., the second electronic device 403 illustrated in FIG. 4, thesecond electronic device 603 illustrated in FIG. 6, the secondelectronic device 703 illustrated in FIG. 7, the second electronicdevice 803 illustrated in FIG. 8, the second electronic device 903illustrated in FIG. 9, the second electronic device 1123 illustrated inFIG. 11, or the second electronic device 1215 illustrated in FIG. 12).Reference number 1555 represents the flow of signals transmittingencoded video data from the second electronic device to the thirdelectronic device 1505 (e.g., the third electronic device 405illustrated in FIG. 4, the third electronic device 605 illustrated inFIG. 6, the third electronic device 705 illustrated in FIG. 7, the thirdelectronic device 805 illustrated in FIG. 8, the third electronic device905 illustrated in FIG. 9, or the third electronic device 1413illustrated in FIG. 14A).

In various embodiments of the present disclosure, the second electronicdevice creates a still image in such a way that the decoder 1507 (e.g.,the decoder 1407 illustrated in FIG. 14A or 14B) decodes a video 1521received from the first electronic device via the first network 1523(e.g., the first network 411 illustrated in FIG. 4). The post process1506 (e.g., the post process 1406 illustrated in FIG. 14A or 14B) iscapable of receiving the decoded video data from the decoder 1507. TheI-frame extractor 1515 (e.g., the I-frame extractor 1415 illustrated inFIG. 14B) of the post process 1506 extracts an I-frame from the receivedvideo data and transfers the I-frame to the comparator 1517 (e.g., thecomparator 1417 illustrated in FIG. 14B). The comparator 1517 is capableof comparing a previous I-frame, e.g., a first I-frame, with a currentI-framed, e.g., a second I-frame, and determining a degree ofsimilarity, based on criterions 1535 received from the video callmanager. For example, when the comparator 1517 ascertains that thesimilarity exceeds the criterions 1535 (e.g., the displacement of avideo is relatively large), it is capable of transferring the secondI-frame to the image creator 1519 (e.g., the image creator 1419illustrated in FIG. 14B).

In various embodiments of the present disclosure, the comparator 1517 ofthe second electronic device is capable of adjusting a cycle forobtaining still images, based on: status information (e.g., signalquality) regarding a network connecting the second electronic device andthe third electronic device 1505, e.g., the second network 1531; andinformation regarding the third electronic device 1505 (e.g., a type ofelectronic device, display size, processing power, maximum resolution,current battery level (capacity), memory usage, presence/absence of acamera, video call windows size (a resolution difference between whenperforming a video call via a multi-window and the entire screen),supporting codec, the number of applications in use, a type ofapplication, etc.), from the third electronic device 1505, via thesecond network 1531 (e.g., the second network 413 illustrated in FIG.4). For example, when the second electronic device ascertains that thequality of the second network 1531 is a relatively high level to performa video call and the battery level is relatively high, it is capable ofsetting the cycle for obtaining still images to 1 second. When thesecond electronic device ascertains that the quality of the secondnetwork 1531 is a relatively high level to perform a video call but thebattery level is relatively low, it is capable of setting the cycle forobtaining still images to 3 seconds. When the second electronic deviceascertains that the quality of the second network 1531 is a relativelylow level to perform a video call and the battery level is relativelylow, it is capable of setting the cycle for obtaining still images to 5seconds. Although the embodiment sets the cycle for obtaining stillimages to 1, 3 and 5 seconds based on the quality of the second network1531 and the battery level, it should be understood that the presentdisclosure is not limited to the embodiment. It should be understoodthat the cycle for obtaining still images may also be set to any othervalue.

In various embodiments of the present disclosure, the image creator 1519is capable of creating still images based on the second I-frame receivedfrom the comparator 1517.

In various embodiments of the present disclosure, the I-frames may bestored in a buffer before they are transferred to the image creator1519. Each I-frame may be stored in the buffer, along with an assignedidentification code, using a number, a mark, a character, or the like.The identification code may be assigned, based on time information,sequence information, calling and called parties' accounts, informationregarding electronic devices providing services (e.g., a name or a macaddress of an electronic device). When the second electronic devicereceives a request for capturing or storing a displayed video from thethird electronic device 1505, it is capable of: searching the buffer fora high-resolution image which has not been encoded with an I-frame,corresponding to video data corresponding to the capture or storagerequest, using an identification code assigned to the I-frame; andstoring the video image as a high-resolution video.

The high-resolution video may be stored in the second electronic deviceor the third electronic device 1505. The buffer may be a cyclic buffer.

The image creator 1519 is capable of transmitting the created stillimage to the third electronic device 1505 via the network manager, e.g.,BT modem 1533.

Although the embodiment is described in such a way to create stillimages in comparison of I-frames, it should be understood that thepresent disclosure is not limited thereto. The embodiment may also bemodified in such a way that still images are created based on direction(movement) vector variation, key frame variation, dominant colorvariation of video, a cycle of a specified time interval, any circle ofa random time interval, etc.

Various embodiments of the present disclosure are capable of using thechange in content of video data as a trigger point for creating animage. For example, when the image creator 1519 of the second electronicdevice detects a change in a specified region of video data, e.g., achange in creation or modification of a subtitle, a change in acharacter's face or the number of characters in a video, etc., it iscapable of recognizing the change as a trigger point and creating astill image. When the image creator 1519 of the second electronic deviceascertains that a specified video is illustrated or a specified regionis changed in a video, it is capable of creating a still image. Forexample, the image creator 1519 of the second electronic device iscapable of obtaining a still image each time that score information isillustrated in a specified region of a TV screen displaying a baseballgame broadcast. When the image creator 1519 recognizes a change in scoreinformation via the comparator 1517 of the second electronic device, itis capable of creating a still image.

In various embodiments of the present disclosure, the image creator 1519is capable of determining the size and/or the picture quality of a stillimage, based on information regarding the third electronic device 1505and the second network 1531. For example, when the third electronicdevice 1505 has a relatively small size of display, it is capable ofaltering the size of a video to a size suitable for a display window,regardless of a size of the video, or adjusting a quantization level ofa video, thereby adjusting the picture quality of the still image.

In various embodiments of the present disclosure, the second electronicdevice is capable of transmitting, in real-time: the created still image1541 to the third electronic device 1505 via a serial port profile (SPP)1543 of the BT modem 1533; and the audio signal 1545 to the thirdelectronic device 1505, via a hands free profile (HFP) 1547 of the BTmodem 1533.

In various embodiments of the present disclosure, the SPP 1543 and theHFP 1547 are capable of connecting to different electronic devicesrespectively. For example, the still image 1541 is transmitted via theSPP 1543 to the third electronic device 1505 and played back therein.The audio signal 1545 is transmitted via the HFP 1547 to an externalspeaker or an audio device such as a Bluetooth headset and played backthereby.

Although the embodiment is described in such a way that video data andvoice signals are transmitted to the third electronic device 1505 usingdifferent methods, it should be understood that the present disclosureis not limited to those embodiments. The embodiment may be modified insuch a way as to encode video data and voice signals into a single fileand transmit the file to the electronic device. For example, afterencrypting voice signals into an image file or an image file into voicesignals, the second electronic device is capable of transmitting theencrypted result to the third electronic device 1505 via the SPP of theBluetooth.

In various embodiments of the present disclosure, the video data and thevoice signals, required to perform a video call, may be played backselectively according to conditions. For example, according to statusinformation regarding the electronic device and the quality of network,video data and voice data may be played back or voice data may only beplayed back. The configuration for selectively playing back video dataor voice data, based on network status information, is described indetail below.

In various embodiments of the present disclosure, when the quality ofthe first network (e.g., the first network 411 illustrated in FIG. 4 orthe first network 1523 illustrated in FIG. 15) or the second network(e.g., the second network 413 illustrated in FIG. 4 or the secondnetwork 1531 illustrated in FIG. 15) is relatively high to perform avideo call, and the battery level of the third electronic device (e.g.,the third electronic device 405 illustrated in FIG. 4, the thirdelectronic device 605 illustrated in FIG. 6, the third electronic device705 illustrated in FIG. 7, the third electronic device 805 illustratedin FIG. 8, the third electronic device 905 illustrated in FIG. 9, thethird electronic device 1413 illustrated in FIG. 14A, or the thirdelectronic device 1505 illustrated in FIG. 15) is relatively high, thesecond electronic device (e.g., the second electronic device 403illustrated in FIG. 4, the second electronic device 603 illustrated inFIG. 6, the second electronic device 703 illustrated in FIG. 7, thesecond electronic device 803 illustrated in FIG. 8, the secondelectronic device 903 illustrated in FIG. 9, the second electronicdevice 1123 illustrated in FIG. 11, or the second electronic device 1215illustrated in FIG. 12) is capable of: adjusting video data forperforming a video call, using a transcoding scheme parameter suitablefor the network quality; and encoding the video data, via thetranscoding scheme. That is, the second electronic device is capable of:adjusting resolution, frame rate (fps) or picture quality of video datato create video data which can be used for a video call at a relativelylow transfer rate, and transmitting the video data to the thirdelectronic device.

In various embodiments of the present disclosure, when the quality ofthe first or second network is deteriorated, the second electronicdevice transmits, to the third electronic device, audio signals, inreal-time, and still images, instead of video data, at a certaininterval (e.g., a transfer cycle determined the network state).Therefore, the user may be provided with a limited video call service.

In various embodiments of the present disclosure, when the quality ofthe first or second network is further deteriorated, the secondelectronic device does not transmit, to the third electronic device,video data, but transmits only audio signals, so that the user canperform a voice call.

In various embodiments of the present disclosure, when the quality ofthe first or second network is worst or the distance between the secondand third electronic devices exceeds a threshold, the second electronicdevice determines that it cannot provide the third electronic devicewith a video call service, and thus switches a video call to anotherelectronic device or terminates the video call.

In another embodiment, while the second electronic device is performinga video call via the third electronic device, it is capable of detectingthe movement of the third electronic device. The third electronic deviceis capable of: estimating the quality of a network connecting to thesecond electronic device, based on the moving direction and thedisplacement change; and providing a corresponding notification to thesecond electronic device. For example, when the third electronic devicedetects the decrease in the network quality since it moves away from thesecond electronic device, it is capable of notifying the secondelectronic device that the video call quality is deteriorated, via anotification, such as vibration, a message, etc.

FIG. 16 is a flowchart illustrating an example method of reproducingvideo data in a third electronic device according to various exampleembodiments of the present disclosure.

In various embodiments of the present disclosure, the third electronicdevice (e.g., the third electronic device 405 illustrated in FIG. 4, thethird electronic device 605 illustrated in FIG. 6, the third electronicdevice 705 illustrated in FIG. 7, the third electronic device 805illustrated in FIG. 8, the third electronic device 905 illustrated inFIG. 9, the third electronic device 1413 illustrated in FIG. 14A, or thethird electronic device 1505 illustrated in FIG. 15) detects themovement, it is capable of controlling a video call service according tothe movement.

With reference to FIG. 16, the third electronic device is capable ofperforming a video call in operation 1601. The third electronic deviceis capable of determining whether it detects its movement in operation1603.

When the third electronic device detects its movement in operation 1603,it collects sensed information regarding its movement via the sensor inoperation 1605. The third electronic device selectively plays back videodata or audio signals, based on the collected sensed information inoperation 1607.

For example, the third electronic device is capable of measuring amovement angle of its head, using a geomagnetic sensor. The thirdelectronic device is capable of detecting its movement, using anacceleration sensor and a gyro sensor. The third electronic device iscapable of collecting sensed information according to its movement, viathe geomagnetic sensor, acceleration sensor or gyro sensor.

In various embodiments of the present disclosure, the third electronicdevice is implemented with a watch. In this case, the third electronicdevice is capable of controlling the playback of video data according tothe movement of a user's hand wearing the watch (e.g., a movement angleof the head of the watch, measured by geomagnetic sensor). For example,when the user puts the hand down (e.g., when a movement angle of thehead of the third electronic device changes from 0° to 90°), the thirdelectronic device determines that the user is performing a video call,via only voice, without viewing a video of a video call. When the userputs the hand up (e.g., when a movement angle of the head of the thirdelectronic device changes from 90° to 0°), the third electronic devicedetermines that the user is performing a video call, via a video andvoice, viewing a video of the video call. That is, in variousembodiments of the present disclosure, the third electronic deviceanalyzes the collected sensed information and ascertains that themovement of the electronic device is within a preset range, it iscapable of storing video data in the memory, while reproducing theaudio. On the other hand, when the third electronic device ascertainsthat the movement of the electronic device is not within a preset range,it is capable of reproducing video streams stored in the memory.

In various embodiments of the present disclosure, when the thirdelectronic device is equipped with a video input module, e.g., a camera,it is capable of obtaining the movement of a user's eyes via the sensor,determining whether the user fixes their eyes on the screen, andcontrolling the playback of video data based on the determination.Alternatively, the third electronic device is capable of performing therecognition of a user's face and/or iris, and determining whether theuser fixes their eyes on the screen.

In various embodiments of the present disclosure, when the thirdelectronic device ascertains that the user is performing a video call,using only voice, it stores the video data in a buffer, without updatingthe video data, and receives only the voice.

When the third electronic device recognizes the face and/or iris, viathe camera, it is capable of playing back a video stored in a buffer, ina slide show mode, at a relatively high speed. Therefore, the user maycheck the updated images without missing out.

In various embodiments of the present disclosure, a playback speed ofslides may vary depending on the number of images to be played back. Forexample, when a slide playback time has been set to a specified periodof time, 30 images and 10 images may set their playback speeds todifferent values to be played within the set period of time.Alternatively, a required time for playback may vary depending on thenumber of images to be played back. Therefore, various embodiments ofthe present disclosure are capable of preventing images from beingplayed back too fast or slow.

Various embodiments of the present disclosure are capable of compressingand storing the displayed video data. For example, when third electronicdevice does not recognize a user's face and/or iris, it determines thatthe user has not fixed their eyes on the screen and stores video datacorresponding to when the user does not gaze.

In various embodiments of the present disclosure, when the thirdelectronic device recognizes a user's face and/or iris via the camera,it is capable of playing back video data which has been compressed andstored.

In various embodiments of the present disclosure, when the thirdelectronic device does not recognize a user's face and/or iris via thecamera, it is capable of extracting a key frame from the video data, andcreating and storing an image. When the third electronic devicerecognizes a user's face and/or iris via the camera, it is capable ofplaying back stored images in a slideshow mode.

FIGS. 17A and 17B are diagrams illustrating an example method ofencoding video data in a second electronic device according to variousexample embodiments of the present disclosure.

In various embodiments of the present disclosure, the second electronicdevice 1703 (e.g., the second electronic device 403 illustrated in FIG.4, the second electronic device 603 illustrated in FIG. 6, the secondelectronic device 703 illustrated in FIG. 7, the second electronicdevice 803 illustrated in FIG. 8, the second electronic device 903illustrated in FIG. 9, the second electronic device 1123 illustrated inFIG. 11, or the second electronic device 1215 illustrated in FIG. 12) iscapable of encoding video data using a scalable encoding (spatial andtime domain) scheme. The scalable encoding is processes of dividinginput video streams into video streams of two or more layers, i.e., ahierarchical structure, and encoding the video streams. In the scalableencoding, a video sequence may be compressed into a number layers, e.g.,a base layer and one or more enhanced layers. The base layer is bitstreams which can be independently decoded and may contain informationfor restoring a minimum quality of video. The enhanced layer isadditional bit streams to improve the base layer bit stream and may bedecoded along with the base layer. Therefore, the scalable encoding iscapable of encoding a number of video layers into one bit stream. Thatis, the hierarchical streams may be played back using only a base layer.When the hierarchical streams may be played back with enhanced layersthat differ from the base layer, high quality of video in layers may beobtained according to the number of enhanced layers in use.

In various embodiments of the present disclosure, the second electronicdevice 1703 is capable of receiving all layers of scalable encodingsignals from the first electronic device 1701 (e.g., the firstelectronic device 401 illustrated in FIG. 4, the first electronic device601 illustrated in FIG. 6, the first electronic device 701 illustratedin FIG. 7, the first electronic device 801 illustrated in FIG. 8, thefirst electronic device 901 illustrated in FIG. 9, or the firstelectronic device 1401 illustrated in FIG. 14A). The second electronicdevice 1703 is capable of transmitting only a base layer of the receivedall layers to the third electronic device 1705 (e.g., the thirdelectronic device 405 illustrated in FIG. 4, the third electronic device605 illustrated in FIG. 6, the third electronic device 705 illustratedin FIG. 7, the third electronic device 805 illustrated in FIG. 8, thethird electronic device 905 illustrated in FIG. 9, the third electronicdevice 1413 illustrated in FIG. 14A, or the third electronic device 1505illustrated in FIG. 15). Alternatively, the second electronic device1703 is capable of: determining an enhanced layer to be transmittedalong with a base layer, based on basic information and current statusinformation regarding the third electronic device 1705 or statusinformation regarding the second network between the second electronicdevice 1703 and the third electronic device 1705 (e.g., the secondnetwork 413 illustrated in FIG. 4, or the second network 1531illustrated in FIG. 15); and transmitting the base layer and thedetermined enhanced layer to the third electronic device 1705.

In various embodiments of the present disclosure, when the firstelectronic device 1701 performs the encoding operation using a scalableencoding scheme and transmits the encoded result to the secondelectronic device 1703, the second electronic device 1703 is capable ofdetermining enhanced layers to be transmitted to the third electronicdevice 1705, based on current status information and basic informationregarding the third electronic device 1705 (e.g., type, display size,display shape (e.g., circle, rectangle, or square), battery capacity,display resolution, CPU power) or status information regarding thesecond network between the second electronic device 1703 and the thirdelectronic device 1705 (e.g., the second network 413 illustrated in FIG.4 or the second network 1531 illustrated in FIG. 15). That is, thesecond electronic device 1703 is capable of transmitting, to the thirdelectronic device 1705 to which a current video call is made, a baselayer received from the first electronic device 1701 or a combination ofthe base layer with at least one enhanced layer, considering a state ofthe third electronic device 1705.

In various embodiments of the present disclosure, information regardingthe second electronic device 1703 may have been registered in a useraccount cooperation server. Alternatively, when the first electronicdevice 1701 makes a call to the second electronic device 1703, it iscapable of obtaining the information regarding the second electronicdevice 1703 from the second electronic device 1703. For example, theuser account cooperation server is capable of managing users' electronicdevices and information regarding the electronic devices (e.g., statusinformation), based on user accounts (e.g., IDs). The user accountcooperation server is capable of providing a calling electronic device(e.g., first electronic device) to make a video call with informationregarding a called electronic device.

It is assumed that the second electronic device 1703 is connected, viaBluetooth, with a third electronic device 1705, e.g., a watch with ascreen of 2 inches, as illustrated in FIG. 17A, and a car kit with ascreen of 7 inches as illustrated in FIG. 17B, and this statusinformation, as use information regarding a user's devices, is updatedin the user account cooperation server.

In various embodiments of the present disclosure, the first electronicdevice 1701 is capable of determining a scheme for encoding video data,e.g., a scalable encoding scheme, based on device information stored inthe user account cooperation server.

For example, the user may set the electronic device, and the watch andthe car kit (a car entertainment system, a car control system, etc.),connected to the electronic device, to be in use, and may register thewatch and the car kit in the user account cooperation server. The useraccount cooperation server is capable of monitoring the registeredelectronic devices, e.g., a watch, a car kit, etc. In a state where theuser account cooperation server is monitoring a vehicle as a registeredelectronic device, when it detects the change in its status information,it is capable of updating the status information regarding the vehicle.

In various embodiments of the present disclosure, the first electronicdevice 1701 may configure enhanced layers in various types according totime and spatial requirements. The first electronic device 1701transmits the variously configured, enhanced layers to the thirdelectronic device 1705 connected to the second electronic device 1703via the second network. The first electronic device 1701 is capable ofcreating a base layer and enhanced layers, considering a temporalresolution (7.5 fps, 15 fps, or 30 fps) and a spatial resolution (QCIF,CIF, or QVGA).

Since the user account cooperation server stores information regarding awatch and a car kit, the first electronic device 1701 is capable ofperforming a video call with the watch and/or the car kit. The firstelectronic device 1701 is capable of encoding video data for a videocall with the watch and the car kit. For example, the first electronicdevice 1701 is capable of: encoding, based on a base layer 1711, videodata to enhanced layer #1 (1713) of low quality for a watch, enhancedlayer #2 (1715) of high quality for a watch, enhanced layer #3 (1717) oflow quality for a car kit, and enhanced layer #4 (1719) of high qualityfor a car kit; and transmitting the encoded results to the secondelectronic device 1703.

For example, when the third electronic device 1705 receives a video callvia a watch as illustrated in FIG. 17A, the second electronic device1703 is capable of transmitting: to the watch, only the base layer 1711,based on status information regarding the second network, and currentinformation regarding the watch, such as the memory usage, the batterylevel, etc.; or to the third electronic device 1705, enhanced layer #1(1713) corresponding to encoded video data of low quality for the watchand the base layer 1711.

When the third electronic device 1705 receives a video call via a carkit as illustrated in FIG. 17B, the second electronic device 1703 iscapable of transmitting: to the car kit, only the base layer 1711, basedon status information regarding the second network, and currentinformation regarding the car kit, such as the memory usage, CPU power,process occupancy by the operating system, etc.; or to the thirdelectronic device 1705, enhanced layer #3 (1717) corresponding toencoded video data of low quality for the car kit and the base layer1711.

FIG. 18 is a diagram illustrating an example method of encoding videodata in a second electronic device according to various exampleembodiments of the present disclosure.

With reference to FIG. 18, the second electronic device (e.g., thesecond electronic device 403 illustrated in FIG. 4, the secondelectronic device 603 illustrated in FIG. 6, the second electronicdevice 703 illustrated in FIG. 7, the second electronic device 803illustrated in FIG. 8, the second electronic device 903 illustrated inFIG. 9, the second electronic device 1123 illustrated in FIG. 11, thesecond electronic device 1215 illustrated in FIG. 12, the secondelectronic device 1703 illustrated in FIG. 17A or 17B) is capable ofencoding video data using a mirroring/resized-mirroring scheme.

In various embodiments of the present disclosure, the second electronicdevice is capable of transmitting mirroring video data resized based onvideo data received from the first electronic device (e.g., the firstelectronic device 401 illustrated in FIG. 4, the first electronic device601 illustrated in FIG. 6, the first electronic device 701 illustratedin FIG. 7, the first electronic device 801 illustrated in FIG. 8, thefirst electronic device 901 illustrated in FIG. 9, the first electronicdevice 1401 illustrated in FIG. 14A, the first electronic device 1701illustrated in FIG. 17A or 17B) to the third electronic device (e.g.,the third electronic device 405 illustrated in FIG. 4, the thirdelectronic device 605 illustrated in FIG. 6, the third electronic device705 illustrated in FIG. 7, the third electronic device 805 illustratedin FIG. 8, the third electronic device 905 illustrated in FIG. 9, thethird electronic device 1413 illustrated in FIG. 14A, the thirdelectronic device 1505 illustrated in FIG. 15, the third electronicdevice 1705 illustrated in FIG. 17A or 17B). The second electronicdevice is capable of determining a resize of video data, based oninformation regarding the third electronic device (e.g., type, displaysize, CPU power, screen shape, battery level, or memory usage) andstatus information regarding the second network (e.g., the secondnetwork 413 illustrated in FIG. 4, or the second network 1531illustrated in FIG. 15) connecting the second and third electronicdevices.

In various embodiments of the present disclosure, the second electronicdevice is capable of moving the focus of mirroring video data orcropping mirroring video data, using the content and the display shape(e.g., circle, square, or rectangle) of the third electronic device, andtransmitting the result to the third electronic device. The secondelectronic device is capable of: focusing or cropping mirroring videodata with respect to the center; or focusing or cropping mirroring videodata, using the facial recognition or the object recognition, andtransmitting the result to the third electronic device.

The third electronic device is an electronic device with a displayshaped as a square as illustrated in diagram 1803 or a circle asillustrated in diagram 1805. When video data displayed on a rectangledisplay screen of the electronic device 1801 whose height is larger thanthe width needs to be displayed on a square or circle display screen ofthe electronic device 1803 or 1805, the second electronic devicerecognizes only the face region in the video data displayed on theelectronic device 1801 and crops the region for the display shape, e.g.,a square shape 1803 or a circle shape 1805. The second electronic deviceis capable of transmitting only the cropped face region to the thirdelectronic device. The third electronic device is capable of displayingthe video data corresponding to the face region, received from thesecond electronic device.

FIGS. 19A and 19B are diagrams illustrating an example user interfacerelated to the reception/transmission of a video call according tovarious example embodiments of the present disclosure.

With reference to FIGS. 19A and 19B, the second electronic device (e.g.,the second electronic device 403 illustrated in FIG. 4, the secondelectronic device 603 illustrated in FIG. 6, the second electronicdevice 703 illustrated in FIG. 7, the second electronic device 803illustrated in FIG. 8, the second electronic device 903 illustrated inFIG. 9, the second electronic device 1123 illustrated in FIG. 11, thesecond electronic device 1215 illustrated in FIG. 12, the secondelectronic device 1703 illustrated in FIG. 17A or 17B) receives a videocall request from the first electronic device (e.g., the firstelectronic device 401 illustrated in FIG. 4, the first electronic device601 illustrated in FIG. 6, the first electronic device 701 illustratedin FIG. 7, the first electronic device 801 illustrated in FIG. 8, thefirst electronic device 901 illustrated in FIG. 9, the first electronicdevice 1401 illustrated in FIG. 14A, the first electronic device 1701illustrated in FIG. 17A or 17B), and transmits a notification to thethird electronic device (e.g., the third electronic device 405illustrated in FIG. 4, the third electronic device 605 illustrated inFIG. 6, the third electronic device 705 illustrated in FIG. 7, the thirdelectronic device 805 illustrated in FIG. 8, the third electronic device905 illustrated in FIG. 9, the third electronic device 1413 illustratedin FIG. 14A, the third electronic device 1505 illustrated in FIG. 15,the third electronic device 1705 illustrated in FIG. 17A or 17B)connected to the second electronic device via the second network (e.g.,the second network 413 illustrated in FIG. 4, or the second network 1531illustrated in FIG. 15). After receiving the notification, the thirdelectronic device is capable of: determining whether it can make a videocall, based on status information regarding the second network connectedto the second electronic device, information regarding battery level,memory usage, process schedule, etc. of the second and third electronicdevices; and displaying the determination on the display screen.

For example, when the quality of the second network is relatively highto perform a video call and the battery level is also high level, thethird electronic device is capable of displaying a user interface oficons corresponding to video calling 1901 to the second electronicdevice, video calling 1903 to third electronic device, voice calling1905 to the third electronic device, call rejection 1907, etc. asillustrated in FIG. 19A.

In various embodiments of the present disclosure, when the thirdelectronic device receives video data for a video call, it is capable ofdisplaying a user interface for receiving a video of low quality or highquality, along with video call quality information such as frame rate(fps), resolution information regarding the video data, etc.

In various embodiments of the present disclosure, when the thirdelectronic device makes a video call to an external electronic device,e.g., the first electronic device is capable of: determining whether avideo call is possible, based on status information regarding the secondnetwork with the second electronic device, status information regardingthe first network (e.g., the first network 411 illustrated in FIG. 4, orthe first network 1523 illustrated in FIG. 15), information regardingthe first to third electronic devices, such as battery level, memorystatus, schedule states of the processor, etc.; and displaying thedetermination on the user interface. For example, when the quality ofthe second network is relatively low to perform a video call or thebattery level is relatively low, the third electronic device is capableof displaying a user interface of icons corresponding to video calling1913 using only voice to an external electronic device, e.g., firstelectronic device, and video calling 1911 with the second electronicdevice, etc., as illustrated in FIG. 19B.

In various embodiments of the present disclosure, the third electronicdevice is capable of serving as a controller or a hub for connecting avideo call to another electronic device. In this case, the firstelectronic device is capable of performing a video call using a devicewhich is registered in the first to third electronic devices via thethird electronic device or a device which is not registered but isavailable.

FIGS. 20A, 20B, 20C and 20D are diagrams illustrating an example userinterface for receiving a video call according to various exampleembodiments of the present disclosure.

With reference to FIGS. 20A to 20D, the third electronic device (e.g.,the third electronic device 405 illustrated in FIG. 4, the thirdelectronic device 605 illustrated in FIG. 6, the third electronic device705 illustrated in FIG. 7, the third electronic device 805 illustratedin FIG. 8, the third electronic device 905 illustrated in FIG. 9, thethird electronic device 1413 illustrated in FIG. 14A, the thirdelectronic device 1505 illustrated in FIG. 15, the first electronicdevice 1701 illustrated in FIG. 17A or 17B) is capable of displaying:the third electronic device or an electronic device connected to thethird electronic device; an electronic device connected to or registeredin the second electronic device (e.g., the second electronic device 403illustrated in FIG. 4, the second electronic device 603 illustrated inFIG. 6, the second electronic device 703 illustrated in FIG. 7, thesecond electronic device 803 illustrated in FIG. 8, the secondelectronic device 903 illustrated in FIG. 9, the second electronicdevice 1123 illustrated in FIG. 11, the second electronic device 1215illustrated in FIG. 12, the second electronic device 1703 illustrated inFIG. 17A or 17B); and an electronic device which is not registered inthe second or third electronic device but is connectable. When the thirdelectronic device receives an input for selecting one of the displayedelectronic devices capable of performing a video call, it is capable oftransmitting a video call signal to the selected electronic device.

In various embodiments of the present disclosure, the size of an iconrepresenting an electronic device capable of performing a video call mayindicate a level of video call quality. The video call quality level maybe determined based on the quality of network with each electronicdevice and a state of each electronic device. The size of the icon maybe proportional to the video call quality level. For example, the largerthe size of the icon, the higher the video call quality level. That is,the smaller the size of the icon, the lower the video call qualitylevel.

Although the embodiment is descried in such a way that the size of theicon representing an electronic device capable of performing a videocall varies depending on levels of video call quality, it should beunderstood that the present disclosure is not limited to the embodiment.An icon presenting an electronic device suitable for a video call isdisplayed in such a way as to vary the shape, the color (e.g.,brightness/black-and-white), or the outline. Alternatively, anelectronic device suitable for a video call may be displayed withdifferent icons according to levels of video call quality, e.g., abroken icon showing a relatively low level of quality. That is, variousembodiments of the present disclosure are capable of indicating levelsof video call quality, by varying size, icon shape or color of an iconor a combination thereof.

As illustrated in FIGS. 20A to 20D, the third electronic device iscapable of displaying icons representing electronic devices capable ofperforming a video call. For example, the third electronic device iscapable of displaying an icon 2011 representing a TV, an icon 2013representing a smartphone, an icon 2015 representing a car kit, an icon2017 representing a tablet PC, an icon 2019 representing a headset, anicon 2021 representing video call rejection, and an icon 2023representing a watch.

For example, the third electronic device is capable of displaying the TVicon 2011 larger in size than the other electronic devices, e.g., thesmartphone icon 2013, the car kit icon 2015, the table PC icon 2017, theheadset icon 2019, the video call rejection icon 2021, and the watchicon 2023. That is, when the TV icon 2011 is selected, the firstelectronic device (e.g., the first electronic device 401 illustrated inFIG. 4, the first electronic device 601 illustrated in FIG. 6, the firstelectronic device 701 illustrated in FIG. 7, the first electronic device801 illustrated in FIG. 8, the first electronic device 901 illustratedin FIG. 9, the first electronic device 1401 illustrated in FIG. 14A, thefirst electronic device 1701 illustrated in FIG. 17A or 17B) is capableof performing a video call of high quality with the TV. The car kit icon2015 is relatively smaller in size that the TV icon 2111. That is, whenthe car kit icon 2015 is selected, the communication state with the carkit may be performed in a lower level of quality than the communicationstate with the TV. In this case, the first electronic device is capableof: performing a video call by receiving voice signals, in real-time,and the video at a certain interval, from the car kit; or performing avideo call, using only voice.

Although the embodiment is described in such a way that the size of anicon representing a specified electronic device is adjusted based onlevels of video call quality, it should be understood that the presentdisclosure is not limited to the embodiment. The size of an iconrepresenting a specified electronic device may also be adjusted based ona user's use history, a user's use pattern, context awarenessinformation, etc. The icon representing a specified electronic devicemay be relocated to another location. For example, the icon representinga specified electronic device may be displayed in a form arrangedaccording to the size. The number of icons, types or attributes ofelectronic device to be displayed on the third electronic device may beset by the user.

In various embodiments of the present disclosure, when the thirdelectronic device: receives a video call; ascertains the change from anelectronic device to make a video call to another during a video call;or detects a user's input for changing an electronic device to make acall during a video call, it is capable of displaying electronic devicescapable of performing a video call on the user interface.

In various embodiments of the present disclosure, the third electronicdevice is capable of analyzing: states of the displayed electronicdevices capable of performing a video call; or the quality of networkswith the displayed electronic devices capable of performing a videocall. The third electronic device is capable of determining prioritybased on the analysis and displaying icons corresponding to electronicdevices in different sizes based on the determined priority.

In various embodiments of the present disclosure, the third electronicdevice is capable of analyzing: the change in states (e.g., the changein battery level) of the displayed electronic devices capable ofperforming a video call; or the quality of networks with the displayedelectronic devices capable of performing a video call, in real-time orat a certain time interval. The third electronic device is capable ofadjusting icons corresponding to the electronic devices in size ordisplay location, and displaying the adjusted icons.

Various embodiments of the present disclosure are capable of obtainingthe network quality of each electronic device or status informationregarding the electronic device, based on a certain time interval, anaverage of time intervals, or a threshold, and updating the size and/orlocation of each of the icons representing the electronic devices.Therefore, various embodiments of the present disclosure are capable ofpreventing the size of each of the icons representing the electronicdevices from being changed suddenly.

Various embodiments of the present disclosure are capable of displayingicons representing electronic devices along with additional information,respectively. For example, the additional information may contain anowner (account subscriber) of an electronic device, a name set for anelectronic device, authority information, etc.

In various embodiments of the present disclosure, when the thirdelectronic device receives an input for selecting a specified electronicdevice, it is capable of transmitting a video call connection signal tothe selected, specified electronic device. For example, when the thirdelectronic device detects an input 2025 for selecting a watch icon 2023as illustrated in FIG. 20A, an input 2041 for dragging the watch icon2023 into an originator display window or video call window 2001 asillustrated in FIG. 20B, or an input 2051 for dragging the watch icon2023 into the originator display window or video call window 2001 asillustrated in FIG. 20C, it is capable of transmitting a video callconnection signal to the watch.

In various embodiments of the present disclosure, the third electronicdevice may be implemented with a watch without a stem. In this case, avideo call is performed by selecting an icon representing the electronicdevice. Alternatively, the third electronic device may be implementedwith a watch with a stem (not shown). In this case, a video call isperformed by controlling the stem to select an icon representing theelectronic device. Alternatively, the third electronic device may beimplemented with a watch with a wheel shaped as a circle as illustratedin FIG. 20D. In this case, a video call is performed by rotating thewheel 2061 to select an icon representing the electronic device.

FIG. 20E is a flowchart illustrating an example method of performing avideo call in a third electronic device according to various embodimentsof the present disclosure.

With reference to FIG. 20E, a third electronic device is capable ofreceiving a video call in operation 2071.

In various embodiments of the present disclosure, when the thirdelectronic device receives a video call, it may determine whether it isworn by the user.

In various embodiments of the present disclosure, the third electronicdevice is capable of determining whether it is worn by the user, via asensor, e.g., a geomagnetic sensor, a gravity sensor, a heart-ratesensor, a temperature sensor, etc. For example, when the thirdelectronic device is a watch, it is capable of determining whether it isworn by the user in such a way that a hall effect sensor detects whetherthe watch chains/straps are coupled.

In various embodiments of the present disclosure, when the thirdelectronic device ascertains that it is worn by the user, it is capableof transmitting a sensor signal corresponding to the state of being wornto the second electronic device. The second electronic device does notdisplay a notification based on the received sensor signal and transmitsa control signal to the third electronic device so that the notificationis displayed only on the third electronic device. Therefore, the secondelectronic device does not display a notification of an incoming videocall on its display screen; however, the third electronic devicedirectly performs a video call and displays the notification of anincoming video call on its display screen.

In various embodiments of the present disclosure, the third electronicdevice is capable of displaying notifications of an incoming video call,varying according to locations of the second electronic device. Forexample, when the second electronic device is in a living room, thethird electronic device is capable of outputting a first notificationsound to notify an incoming video call. When the second electronicdevice is in a bedroom, the third electronic device is capable ofoutputting a second notification sound to notify an incoming video call.When the second electronic device is in a dining room, the thirdelectronic device is capable of outputting vibration to notify anincoming video call. When the second electronic device is near theentrance, the third electronic device is capable of turning the flashon/off to notify the reception of a video call request. In variousembodiments of the present disclosure, the third electronic device iscapable of obtaining a location of the second electronic device, via anindoor navigation using Wi-Fi, BLE, etc., or via a communicationnetwork, such as GPS, LTE, or 3G, etc.

In various embodiments of the present disclosure, when receiving a videocall request, the third electronic device is capable of displayingadditional information containing a location of the second electronicdevice, along with a notification indicating the video call requestreception. For example, the third electronic device is capable ofdisplaying a location of the second electronic device obtained from mapinformation stored in the memory, along with a name of a location thatthe user has registered or an attribute and a name of a location storedin a server.

In various embodiments of the present disclosure, when receiving a videocall request, the third electronic device is capable of displaying anarrow mark indicating a location of the second electronic device, alongwith a notification of the video call request reception. For example,the third electronic device is capable of displaying map information,direction information, information regarding a distance from the thirdelectronic device to the second electronic device, and an estimatedperiod of time to reach the second electronic device based on thedistance. The distance information may be displayed in various forms,such as number, color, icon, etc.

In various embodiments of the present disclosure, the third electronicdevice is capable of displaying at least one electronic device capableof performing a video call in operation 2073. The third electronicdevice is capable of displaying: the third electronic device or anelectronic device connected to the third electronic device; anelectronic device registered in or connected to the second electronicdevice; and an electronic device which is not registered in the secondor third electronic device but is connectable to the second electronicdevice.

In various embodiments of the present disclosure, the third electronicdevice is capable of displaying at least one electronic device usingicons. The size of an icon may be determined based on video call qualitylevel (e.g., a state of an electronic device, such as a battery level ora network state), a user's use history, a user's use pattern, contextawareness information, etc. For example, the third electronic device iscapable of setting an icon of an electronic device whose video callquality level is relatively high to be larger in size than a presetsize. The third electronic device is also capable of analyzing a user'suse history or a user's use pattern, and setting an icon of anelectronic device with which the user has frequently performed a videocall to be larger in size than a preset size. In contrast, the thirdelectronic device is capable of setting an icon of an electronic devicewhose video call quality level is relatively low to be smaller in sizethan a preset size. The third electronic device is also capable ofanalyzing a user's use history or a user's use pattern, and setting anicon of an electronic device with which the user has not frequentlyperformed a video call to be smaller in size than a preset size.

In various embodiments of the present disclosure, the third electronicdevice is capable of detecting an input for selecting an electronicdevice to perform a video call from one or more displayed electronicdevices in operation 2075. The third electronic device is capable oftransmitting a video call signal to the selected electronic device inoperation 2077. For example, as described above with reference to FIGS.20A to 20C, the third electronic device is capable of selecting anelectronic device to perform a video call, by detecting: a touch inputapplied to an electronic device to perform a video call; an input fordragging an icon representing an electronic device to perform a videocall to an originator display window or video call window; or an inputfor dragging an originator display window or video call window to anicon representing an electronic device to perform a video call.

In various embodiments of the present disclosure, the third electronicdevice may be implemented with a watch without a stem. In this case, avideo call is performed by selecting an icon representing the electronicdevice. Alternatively, the third electronic device may be implementedwith a watch with a stem (not shown). In this case, a video call isperformed by controlling the stem to select an icon representing theelectronic device. Alternatively, the third electronic device may beimplemented with a watch with a wheel shaped as a circle. In this case,a video call is performed by rotating the wheel to select an iconrepresenting the electronic device.

FIGS. 21A and 21B are diagrams illustrating an example user interfacedepending on pressure levels of the user input according to variousexample embodiments of the present disclosure.

With reference to FIGS. 21A and 21B, when the third electronic device(e.g., the third electronic device 405 illustrated in FIG. 4, the thirdelectronic device 605 illustrated in FIG. 6, the third electronic device705 illustrated in FIG. 7, the third electronic device 805 illustratedin FIG. 8, the third electronic device 905 illustrated in FIG. 9, thethird electronic device 1413 illustrated in FIG. 14A, the thirdelectronic device 1505 illustrated in FIG. 15, the third electronicdevice 1705 illustrated in FIG. 17A or 17B) detects an input forswitching a video call, it is capable of arranging icons of at least oneelectronic device, to which it can switch a video call, to meet itsshape. Examples of the cons of at least one electronic device are anicon 2101 representing a TV, an icon 2103 representing a tablet PC, anicon 2105 representing a headset, an icon 2107 representing asmartphone, an icon 2109 representing a car kit, and an icon 2111representing video call end.

In various embodiments of the present disclosure, the third electronicdevice is capable of performing different functions according topressure levels of the user input selecting an icon presenting aspecified electronic device. For example, when the third electronicdevice detects a touch input of pressure level 1, it is capable ofswitching a video call to a specified electronic device on which thetouch input of pressure level 1 is detected. When the third electronicdevice detects a touch input of pressure level 2, it is capable oftransmitting a notification to a specified electronic device on whichthe touch input of pressure level 2 is detected. The notification allowsthe user to intuitively identify a specified electronic device to whicha video call is switched.

For example, when the third electronic device detects a touch input 2113of pressure level 2 applied to a TV icon 2101 of the displayed icons, itis capable of transmitting a notification to the TV corresponding to theTV icon 2101. Based on the received notification, the TV is capable of:controlling the TV screen to blink; displaying a specified image patternon at least part of the TV screen; and displaying information regardingthe user, e.g., user account information or information regarding thethird electronic device on at least part of the TV screen.Alternatively, when the third electronic device detects a touch input2113 of pressure level 2 applied to a TV icon 2101 of the displayedicons, it is capable of changing a user interface, using “devicechange,” and displaying the user interface, as illustrated in FIGS. 21Aand 21B.

Various embodiments of the present disclosure display a screenillustrated ion the TV and a screen illustrated on the display of thethird electronic device, temporarily matching the screens with eachother, so that the user can intuitively identify the electronic deviceto which a video call signal is transmitted, before connecting the videocall.

In various embodiments of the present disclosure, the third electronicdevice is capable of temporarily displaying an icon representing anelectronic device to which a video call will be switched, by an alteringfunction, on a screen showing icons representing electronic devices towhich a video call can be switched. Alternatively, the third electronicdevice is capable of temporarily displaying an icon representing anelectronic device to which a video call will be switched, by an alteringfunction, at a location displaying an originator's information.

In various embodiments of the present disclosure, when the thirdelectronic device detects a touch input of pressure level 3, it iscapable of displaying details of the electronic device on which thetouch input of pressure level 3 is detected. For example, the thirdelectronic device is capable of displaying details related to attributesof the electronic device on which the touch input is detected andnetwork connection attributes.

FIG. 21C is a flowchart illustrating example functions depending onpressure levels of the user input according to various exampleembodiments of the present disclosure.

With reference to FIG. 21C, when the third electronic device detects aninput for switching a video call in operation 2131, it is capable ofdisplaying at least one electronic device to which a video call can beswitched in operation 2133.

The third electronic device is capable of detecting an input forselecting an electronic device to which a video call is switched from atleast one displayed electronic device, and detecting a pressure level ofthe detected input in operation 2135. The third electronic device iscapable of performing a function related to the selected electronicdevice, based on the pressure level of the detected input in operation2137.

For example, when the third electronic device detects a touch input ofpressure level 1, it is capable of switching a video call to theelectronic device on which the touch input of pressure level 1 isdetected. When third electronic device detects a touch input of pressurelevel 2, it is capable of transmitting a notification to the electronicdevice on which the touch input of pressure level 2 is detected, so thatthe electronic device can output the notification. When the thirdelectronic device 405 detects a touch input of pressure level 3, it iscapable of displaying attribute information regarding the electronicdevice on which the touch input of pressure level 3 is detected, forexample, information regarding the electronic device on which the touchinput is detected or network information.

FIG. 21D is a flowchart illustrating example functions depending onpressure levels of the user input according to various exampleembodiments of the present disclosure.

In various embodiments of the present disclosure, the third electronicdevice is capable of performing different functions according todetected user inputs and pressure levels of the detected user input.

In various embodiments of the present disclosure, the third electronicdevice is capable of recognizing objects of video data, based onlocations where a user input is detected, and adjusting at least one ofthe following: resolution, focus, and exposure, according to pressurelevels applied to a corresponding object.

In various embodiments of the present disclosure, the third electronicdevice is capable of displaying different user interfaces, based on atleast one of the following: a user input, a duration of the user input,an area of the user input (e.g., an area of a user's finger), and alevel of hovering input (e.g., an input tool, such as a user's finger, astylus, etc., or a distance between the input tool to the touchscreen).

With reference to FIG. 21D, the third electronic device is capable ofperforming a video call in operation 2141. The third electronic deviceis capable of detecting a user input in operation 2143. The thirdelectronic device is capable of obtaining a pressure level of thedetected user input in operation 2145. The third electronic device iscapable of performing a function corresponding to the pressure level ofthe user input in operation 2147.

For example, when the third electronic device detects a user input onpart of the region of display during a video call, it is capable ofdisplaying a video call menu. When the third electronic device detects auser input of pressure level 1, it is capable of displaying a userinterface for changing a resolution of video data. When the thirdelectronic device detects a user input of pressure level 2, it iscapable of displaying a user interface for switching a video call. Whenthe third electronic device detects a user input of pressure level 3, itis capable of displaying a user interface for altering picture qualityof video data.

In various embodiments of the present disclosure, when the thirdelectronic device detects a user input of pressure level 1 on at leastpart of the region of a video displayed on the screen, it is capable ofcapturing and storing the video data as still images during a specifiedtime interval or a key frame interval while the user input is maintainedin pressure level 1. When the third electronic device detects a userinput of pressure level 2 on at least part of the region of a videodisplayed on the screen, it is capable of storing the video data as amoving image (video) while the user input is maintained in pressurelevel 2.

In various embodiments of the present disclosure, the third electronicdevice is capable of displaying at least part of the image or movingimage (video), stored according to the user input of pressure level 2,on at least part of the display screen, for a preset period of time. Forexample, the third electronic device is capable of displaying an image,stored in response to the user input of pressure level 2, on at leastpart of the display screen showing video data, e.g., a snap-shot of acertain size on the bottom of the screen. Alternatively, the thirdelectronic device is capable of displaying an icon, indicating that amoving image (video) is being recorded in response to the user input ofpressure level 2, on at least part of the display screen. Therefore,various embodiments of the present disclosure allow the user tointuitively recognize that an image or a moving image (video) is beingstored (or recorded), via an icon indicating the state of a snap-shot orrecording.

In various embodiments of the present disclosure, when third electronicdevice detects a user input of pressure level 1 on part of the region ofa video being displayed, it is capable of requesting a video ofhigh-resolution, corresponding to a video when the user input ofpressure level 1 is detected, from the first electronic device (e.g.,the first electronic device 401 illustrated in FIG. 4, the firstelectronic device 601 illustrated in FIG. 6, the first electronic device701 illustrated in FIG. 7, the first electronic device 801 illustratedin FIG. 8, the first electronic device 901 illustrated in FIG. 9, thefirst electronic device 1401 illustrated in FIG. 14A, the firstelectronic device 1701 illustrated in FIG. 17A or 17B) or the secondelectronic device (e.g., the second electronic device 403 illustrated inFIG. 4, the second electronic device 603 illustrated in FIG. 6, thesecond electronic device 703 illustrated in FIG. 7, the secondelectronic device 803 illustrated in FIG. 8, the second electronicdevice 903 illustrated in FIG. 9, the second electronic device 1123illustrated in FIG. 11, the second electronic device 1215 illustrated inFIG. 12, the second electronic device 1703 illustrated in FIG. 17A or17B). When the third electronic device (e.g., the third electronicdevice 405 illustrated in FIG. 4, the third electronic device 605illustrated in FIG. 6, the third electronic device 705 illustrated inFIG. 7, the third electronic device 805 illustrated in FIG. 8, the thirdelectronic device 905 illustrated in FIG. 9, the third electronic device1413 illustrated in FIG. 14A, the third electronic device 1505illustrated in FIG. 15, the second electronic device 1703 illustrated inFIG. 17A or 17B) detects a user input of pressure level 2 on part of theregion of a video being displayed, it is capable of requesting the firstor second electronic device to adjust the focus of the camera, withrespect to the region where the user input of pressure level 2 isdetected. When the third electronic device detects a user input ofpressure level 3 on part of the region of a video being displayed, it iscapable of requesting the first or second electronic device to adjustthe exposure of the camera, with respect to the region where the userinput of pressure level 3 is detected.

Although the embodiment is described in such a way as to performdifferent functions according to pressure levels of the user input, itshould be understood that the present disclosure is not limited thereto.The embodiment may also be modified in such a way as to performdifferent functions according to directions in which the user input isdetected, which is described in detail, below, with reference to FIG.21E.

FIG. 21E is a flowchart illustrating example functions depending ondirections in which a user input is detected, according to variousembodiments of the present disclosure.

In various embodiments of the present disclosure, the third electronicdevice is capable of performing different functions according todirections in which a user input is detected.

With reference to FIG. 21E, the third electronic device is capable ofperforming a video call in operation 2151. The third electronic deviceis capable of detecting a user input in operation 2153. In variousembodiments of the present disclosure, the user input may include swipeinput and/or drag input. The third electronic device is capable ofidentifying a direction of the detected user input in operation 2155,and performing a function corresponding to the direction of the detecteduser input in operation 2157.

In various embodiments of the present disclosure with reference to FIG.21E, it is assumed that the user input is a swipe action. When the thirdelectronic device detects a user input, e.g., swipe, on at least part ofthe display screen during a video call, it is capable of displaying amenu related to video call. The third electronic device is capable ofanalyzing a direction in which the swipe is detected. The swipe actionmay be performed from left-to-right, from right to left, from top tobottom, and from bottom to top.

For example, when the third electronic device detects a swipe actionfrom left to right, it is capable of displaying a user interface foraltering resolution of video data. When the third electronic devicedetects a swipe action from right to left, it is capable of displaying auser interface for switching a video call. When the third electronicdevice detects a swipe action from top to bottom, it is capable ofdisplaying a user interface for changing picture quality of video data.It should be understood that the present disclosure is not limited tothe functions according to the swipe actions. The resolution, focus andexposure of a video may also be adjusted according to directions of theswipe.

As described above, various embodiments of the present disclosure arecapable of displaying different user interfaces or performing differentfunctions, based on at least one of the following: a user input, aduration of the user input, a hovering level, a pressure level of theuser input, and a direction in which the user input is detected. variousembodiments are also capable of: mapping a displayed user interface,based on at least one of the following: a user input, a duration of theuser input, a level of hovering input (e.g., a distance between an inputtool (e.g., a user's finger or a stylus) and a touchscreen), a pressurelevel of the user input, and a direction in which the user input isdetected; and storing the mapping result in the memory.

FIG. 22A are diagrams illustrating an example user interface includingan indicator indicating the quality of video call according to variousexample embodiments of the present disclosure.

With reference to diagram 2201 of FIG. 22A, the third electronic device(e.g., the third electronic device 405 illustrated in FIG. 4, the thirdelectronic device 605 illustrated in FIG. 6, the third electronic device705 illustrated in FIG. 7, the third electronic device 805 illustratedin FIG. 8, the third electronic device 905 illustrated in FIG. 9, thethird electronic device 1413 illustrated in FIG. 14A, the thirdelectronic device 1505 illustrated in FIG. 15, the second electronicdevice 1703 illustrated in FIG. 17A or 17B) is capable of displayingvideo data 2209 and an indicator 2211 indicating the video call qualityduring a video call. As illustrated in diagram 2203, the thirdelectronic device is also capable of displaying video data 2209, anindicator 2211 indicating the video call quality, and a button 213 forlowering down the resolution (quality) of video data.

As illustrated in diagram 2205, the third electronic device is capableof displaying video data 2209 and the video call quality determinedbased on its information and the network state, and showing a userinterface including an indicator 2215 for controlling the video callquality. For example, the indicator 2215 may include a maximum ofavailable video call quality 2221, determined based on a network stateand information regarding the third electronic device, and the videocall quality 2223 currently in use. The user may intuitively adjust alevel of video call quality on the indicator 2215, using a slide control2223.

For example, the indicator 2215 indicates a maximum of available videocall quality 2221 and the video call quality 2223 currently in use. Whenthe third electronic device detects an input 2225 (e.g., an input forselecting and dragging a video call quality region in the right or left)for adjusting video call quality on the indicator 2215, it is capable ofadjusting the video call quality. The third electronic device is capableof determining an encoding scheme corresponding to the adjusted videocall quality. The third electronic device is capable of transmitting thedetermined encoding scheme to the first electronic device (e.g., thefirst electronic device 401 illustrated in FIG. 4, the first electronicdevice 601 illustrated in FIG. 6, the first electronic device 701illustrated in FIG. 7, the first electronic device 801 illustrated inFIG. 8, the first electronic device 901 illustrated in FIG. 9, the firstelectronic device 1401 illustrated in FIG. 14A, the first electronicdevice 1701 illustrated in FIG. 17A or 17B). The first or secondelectronic device is capable of encoding video data based on theencoding scheme and transmitting the encoded video data to the thirdelectronic device. The third electronic device is capable of reproducingthe received, encoded video data.

As illustrated in diagram 2207, when the indicator 2231 is shaded nearthe left end in the left region with respect to a criterion 2230, itindicates that the video call quality is relatively low. When theindicator 2233 is shaded in the left region from the left end up to thecriterion 2230, it indicates that the video call quality isintermediate. When the indicator 2235 is shaded, extending from the leftend to the right region with respect to the criterion 2230, it indicatesthat the video call quality is relatively high.

Although the embodiment is described in such a way that the video callquality is adjusted by controlling the indicator, it should beunderstood that the present disclosure is not limited thereto. Forexample, when the third electronic device is a watch which is equippedwith a stem (not shown) or a wheel (not shown), the video call qualityis adjusted via the rotation of the stem or wheel, a voice input, agesture input, or a combination thereof.

For example, when battery power consumption needs to be reduced ormulti-tasking process needs for other tasks, various embodiments allowthe user to minimize the level of video call quality. Therefore, variousembodiments of the present disclosure are capable of adjusting the levelof video call quality according to a use's conditions, thereby providingthe user with a relatively high degree of video call servicesatisfaction.

In various embodiments of the present disclosure, when the thirdelectronic device receives and displays video data for video call, it iscapable of displaying information regarding the video call quality suchas a video data resolution, a frame rate (fps), etc., along with thevideo data. When the third electronic device detects an input foradjusting the indicator, it is capable of displaying informationregarding the video call quality corresponding to the adjusted level ofindicator. Since various embodiments of the present disclosure displayvideo data for video call along with information regarding the videocall quality, the user may intuitively recognize information regardingthe currently displayed video data or information regarding the videodata according to the adjusted indicator.

FIG. 22B is a flowchart illustrating an example method of adjusting thequality of video call according to various example embodiments of thepresent disclosure.

With reference to FIG. 22B, while the third electronic device displaysvideo data for video call in operation 2241, it is capable ofdetermining whether an input for adjusting the quality of video data isdetected in operation 2243.

In various embodiments of the present disclosure, the third electronicdevice is capable of displaying video data for video call and anindicator for adjusting the quality of video data on part of the displayunit. The indicator may include the current quality of video data amaximum available quality of video data determined based on a state ofthe third electronic device or a network state.

When the third electronic device has not detected an input for adjustingthe quality of video data via the indicator in operation 2243, itreturns to operation 2241 and displays video data.

On the other hand, when the third electronic device detects an input foradjusting the quality of video data via the indicator in operation 2243,it is capable of determining an encoding scheme based on the adjustedvideo call quality in operation 2245, and transmitting the determinedencoding scheme to the second electronic device in operation 2247.

When the embodiment is implemented in such a way that to encode videodata in the second electronic device, the second electronic device iscapable of encoding video data based on the encoding scheme, receivedfrom the third electronic device, and transmitting the encoded videodata to the third electronic device. Alternatively, when the embodimentis implemented in such a way that to encode video data in the firstelectronic device, the second electronic device is capable oftransmitting the encoding scheme, received from the third electronicdevice, to the first electronic device. In this case, the secondelectronic device receives, from the first electronic device, the videodata that the first electronic device encoded based on the encodingscheme, and forwards the received encoded video data to the thirdelectronic device.

The third electronic device is capable of receiving the video data,encoded based on the encoding scheme, from the second electronic device,and displaying the received video data in operation 2249.

FIGS. 23A and 23B are diagrams illustrating an example user interfacefor switching a video call according to various embodiments of thepresent disclosure.

In various embodiments of the present disclosure, when the thirdelectronic device (e.g., the third electronic device 405 illustrated inFIG. 4, the third electronic device 605 illustrated in FIG. 6, the thirdelectronic device 705 illustrated in FIG. 7, the third electronic device805 illustrated in FIG. 8, the third electronic device 905 illustratedin FIG. 9, the third electronic device 1413 illustrated in FIG. 14A, thethird electronic device 1505 illustrated in FIG. 15, the thirdelectronic device 1705 illustrated in FIG. 17A or 17B) moves or isaffected by external interference signals during a video call, it iscapable of detecting the change in a state of a second network (e.g.,the second network 413 illustrated in FIG. 4, or the second network 1531illustrated in FIG. 15). The third electronic device is also capable ofdetecting: the change in battery status during a video call, shortage ofmemory capacity due to multi-tasking, and insufficiency of processingpower in the third electronic device; the quality degradation of thefirst network (e.g., the first network 411 illustrated in FIG. 4, or thefirst network 1523 illustrated in FIG. 15) connecting the firstelectronic device (e.g., the first electronic device 401 illustrated inFIG. 4, the first electronic device 601 illustrated in FIG. 6, the firstelectronic device 701 illustrated in FIG. 7, the first electronic device801 illustrated in FIG. 8, the first electronic device 901 illustratedin FIG. 9, the first electronic device 1401 illustrated in FIG. 14A, thefirst electronic device 1701 illustrated in FIG. 17A or 17B) and thesecond electronic device (e.g., the second electronic device 403illustrated in FIG. 4, the second electronic device 603 illustrated inFIG. 6, the second electronic device 703 illustrated in FIG. 7, thesecond electronic device 803 illustrated in FIG. 8, the secondelectronic device 903 illustrated in FIG. 9, the second electronicdevice 1123 illustrated in FIG. 11, the second electronic device 1215illustrated in FIG. 12, the second electronic device 1703 illustrated inFIG. 17A or 17B); and the change in the video call quality during avideo call, which is caused by to the change in battery level, short ofmemory capacity or insufficiency of processing power in the first orsecond electronic device.

In various embodiments of the present disclosure, when the thirdelectronic device detects the change in the video call quality, it iscapable of requesting the first or second electronic device performingan encoding operation to change its encoding scheme. The thirdelectronic device is capable of: receiving, from the first or secondelectronic device, video data encoded based on an encoding schemechanged according to the encoding scheme change request; and reproducingthe received video data.

In various embodiments of the present disclosure, when the thirdelectronic device is in a state so that it cannot perform a video call,it is capable of switching the video call to a voice call. When thethird electronic device is in a worse state so that it cannot perform avideo call, it ends a call and switches a video call to the secondelectronic device or another electronic device connected to the secondelectronic device. When the video call is switched to a voice call orwhen the video call is switched to another electronic device connectedto the second electronic device, the third electronic device is capableof informing the user of a video call switching notification, via a userinterface (e.g., a pop-up message) for switching a video call to a voicecall or another electronic device, a voice, or vibration.

In various embodiments of the present disclosure, the third electronicdevice is capable of: obtaining information regarding currentlyconnectable electronic devices from the second electronic device; anddisplaying electronic devices to which a video call is switched,according to priority assigned, based on a user's use pattern, a stateof each electronic device or network connection states.

In various embodiments of the present disclosure, when the thirdelectronic device is in an environment not suitable for providing avideo call service, it is capable of displaying a pop-up messageincluding electronic devices to which it can be connected and switched,so that the user can select a corresponding one of the displayedelectronic devices. For example, as illustrated in FIG. 23A, a pop-upmessage 2311 for switching a video call shows electronic devicesconnected to the second electronic device to which a video call can beswitched, e.g., a smartphone 2313 and a car kit 2315. When the thirdelectronic device detects an input for selecting one of the electronicdevices illustrated in the pop-up message 2311, e.g., a smartphone 2313or a car kit 2315, it is capable of transmitting a video call switchingsignal to the selected electronic device.

In various embodiments of the present disclosure, a video call switchingoperation is processed by the third electronic device performing a videocall or the second electronic device. For example, when the thirdelectronic device detects a signal changing the video call qualityduring a video call, the second electronic device is capable ofdisplaying a pop-up message 2331 for a video call switching operation asillustrated in FIG. 23B. When the second electronic device detects aninput for selecting one of the electronic devices, e.g., a watch 2333, acar kit 2335 and a phone 2337, illustrated in the pop-up message 2331,it is capable of transmitting a video call switching signal to theselected electronic device.

In various embodiments of the present disclosure, when the thirdelectronic device has not detected an input for selecting an electronicdevice to which a video call is switched, it is capable of automaticallyselecting an optimal electronic device from among electronic devices towhich a video call can be switched. The optimal electronic device may beselected, based on status information regarding each electronic device(e.g., battery level, process power, or memory status), a condition asto whether the user is currently using the electronic device, usingnetwork connection information, or previous connection information.

FIG. 23C is a flowchart illustrating an example method of switching avideo call to a third electronic device according to various exampleembodiments of the present disclosure.

With reference to FIG. 23C, a third electronic device is capable ofdetermining whether it detects a signal according to the change of thevideo call quality in operation 2341. For example, the third electronicdevice is capable of detecting a signal showing the change in the stateof a second network, which is caused due to the location change or thepresence of an external interference signals, during a video call.Alternatively, the third electronic device is capable of detecting asignal according to the change of the video call quality, which iscaused by: the change in battery status, shortage of memory capacity,and insufficiency of processing power in the third electronic device;the quality degradation of the first network connecting the first andsecond electronic devices; and the change in battery level, short ofmemory capacity or insufficiency of processing power in the first orsecond electronic device.

When the third electronic device detects the signal according to thechange of the video call quality in operation 2341, it is capable ofdisplaying at least one electronic device to which a video call isswitched in operation 2343. For example, as illustrated in FIG. 23A, thethird electronic device is capable of displaying a pop-up messageincluding at least one electronic device to which a video call can beswitched.

The third electronic device is capable of determining whether an inputfor selecting an electronic device to which a video call is switchedwithin a preset period of time is detected in operation 2345. When thethird electronic device detects an input for selecting an electronicdevice to which a video call is switched within a preset period of timein operation 2345, it is capable of transmitting a signal for switchinga video call to the selected electronic device in operation 2349. Forexample, when the third electronic device detects an input for selectingone of the electronic devices to which a video call is switched in apop-up message, it is capable of transmitting a video call signal to theselected electronic device. Therefore, the first electronic device andthe selected electronic device perform a video call to each other.

On the other hand, when the third electronic device has not detected aninput for selecting an electronic device to which a video call isswitched within a preset period of time in operation 2345, it is capableof automatically selecting an electronic device to which a video call isswitched, based on a preset condition, in operation 2347, andtransmitting a signal for switching a video call to the selectedelectronic device in operation 2349. In various embodiments of thepresent disclosure, the preset condition may be a state of at least oneelectronic device to which a video call can be switched and networkstatus information. The third electronic device is capable of receivingpriority, determined based on a state of at least one of the electronicdevices to which a video call can be switched or network statusinformation, from the second electronic device, and automaticallyswitching a video call to an electronic device with high priority.

Although the embodiments are described in such a way as to: determinewhether an input for selecting an electronic device to which a videocall is switched is detected within a preset period of time; and switcha video call to the selected electronic device based on thedetermination, it should be understood that the present disclosure isnot limited thereto. The embodiments may also display a pop-up windowshowing an option as to whether an electronic device to which a videocall is switched is selected automatically or according to a user input.When the electronic device determines to select an electronic device towhich a video call is switched, according to a user input, via thedisplayed pop-up window, it is capable of performing operations 2345 and2349 illustrated in FIG. 23C. When the electronic device determines toselect an electronic device to which a video call is switched,automatically, on the displayed pop-up window, it is capable ofperforming operations 2347 and 2349 illustrated in FIG. 23C.

FIG. 24 is a diagram illustrating example operations of switching avideo call to a fourth electronic device according to various exampleembodiments of the present disclosure.

With reference to FIG. 24, various embodiments of the present disclosureare capable of switching a video call currently in service to astandalone device with an access function to a standalone network, e.g.,a fourth electronic device 2411.

In various embodiments of the present disclosure, the first electronicdevice 2401 (e.g., the first electronic device 401 illustrated in FIG.4, the first electronic device 601 illustrated in FIG. 6, the firstelectronic device 701 illustrated in FIG. 7, the first electronic device801 illustrated in FIG. 8, the first electronic device 901 illustratedin FIG. 9, the first electronic device 1401 illustrated in FIG. 14A, thefirst electronic device 1701 illustrated in FIG. 17A or 17B) and thesecond electronic device 2405 (e.g., the second electronic device 403illustrated in FIG. 4, the second electronic device 603 illustrated inFIG. 6, the second electronic device 703 illustrated in FIG. 7, thesecond electronic device 803 illustrated in FIG. 8, the secondelectronic device 903 illustrated in FIG. 9, the second electronicdevice 1123 illustrated in FIG. 11, the second electronic device 1215illustrated in FIG. 12, the second electronic device 1703 illustrated inFIG. 17A or 17B) are connected to each other via the first network 2403(e.g., the first network 411 illustrated in FIG. 4, the first network1523 illustrated in FIG. 15). The second electronic device 2405 and thethird electronic device 2409 (e.g., the third electronic device 405illustrated in FIG. 4, the third electronic device 605 illustrated inFIG. 6, the third electronic device 705 illustrated in FIG. 7, the thirdelectronic device 805 illustrated in FIG. 8, the third electronic device905 illustrated in FIG. 9, the third electronic device 1413 illustratedin FIG. 14A, the third electronic device 1505 illustrated in FIG. 15,the third electronic device 1705 illustrated in FIG. 17A or 17B) areconnected to each other via the second network 2407 (e.g., the secondnetwork 413 illustrated in FIG. 4, or the second network 1531illustrated in FIG. 15). In addition, a fourth electronic device 2411 iscapable of connecting to an external network independently via a thirdnetwork 2413, e.g., Wi-Fi, etc. Alternatively, the fourth electronicdevice 2411 is also capable of connecting to an external network via awired network.

The fourth electronic device 2411 is a device which is connected to orregistered in the second electronic device 2405. Alternatively, thefourth electronic device 2411 may be a new device which is not connectedto or is not registered in the second electronic device 2405. The fourthelectronic device 2411 may be devices for public use, such as a TV or amonitor installed in public places. The owner and the user of the secondelectronic device 2405 may differ from those of the fourth electronicdevice 2411.

The second electronic device 2405 or the third electronic device 2409,connected to the second electronic device 2405 via the second network2407, is capable of requesting to switch a video call currently inservice to the fourth electronic device 2411. The fourth electronicdevice 2411 is capable of requesting the second electronic device 2405or the third electronic device 2409 to switch a video call. The fourthelectronic device 2411 and the second electronic device 2405 or thethird electronic device 2409 are capable of performing thetransmission/reception of data for switching a video call to each other,as in operations 2417 and 2419. Examples of the data for switching avideo call are IP information, MAC information, secure certificationinformation, VPN configuration information, or electronic deviceidentification information. For example, the fourth electronic device2411 is capable of requesting the second electronic device 2405 or thethird electronic device 2409 to switch a video call, via an NFC tagging,RFID, BLE, BT broadcasting, etc.

In various embodiments of the present disclosure, the third electronicdevice 2409 providing a video call service or the second electronicdevice 2405, connected to the third electronic device 2409 via thesecond network 2407, is capable of displaying an image pattern, QR codeor encryption data, in order to switch a video call. The fourthelectronic device 2411 is capable of obtaining video call informationfrom the displayed image pattern, QR code or encryption data via animage sensor, and requesting the connection of a video call.

For example, when the fourth electronic device 2411 detects an input forselecting a menu for requesting to switch a video call, e.g., “videocall connecting,” it is capable of activating a camera and transmittinga pattern of brightness signals of an LED or LCD screen or a flash tothe second electronic device 2405 or the third electronic device 2409.The second electronic device 2405 of the third electronic device 2409 iscapable of temporarily displaying a specified image pattern forswitching a video call on the display unit, based on the pattern ofsignals received from the fourth electronic device 2411. The fourthelectronic device 2411 is capable of reading the specified image patternvia the image sensor and performing the transmission/reception of datafor switching a video call, based on the specified image pattern.

In various embodiments of the present disclosure, the second electronicdevice 2405 or the third electronic device 2409 is capable of acceptinga video call with the fourth electronic device 2411, before connectingto the fourth electronic device 2411 or transmitting data for switchinga video call.

In various embodiments of the present disclosure, the fourth electronicdevice 2411 is capable of inserting information regarding the fourthelectronic device 2411 into a specified ultrasonic or sonic wavepattern, and making a video call request to the second electronic device2405 or the third electronic device 2409 via a speaker and a microphoneor transmitting/receiving data for switching a video call to/from thesecond electronic device 2405 or the third electronic device 2409.

For example, the fourth electronic device 2411 is capable of insertingits information, e.g., type, MAC information, connection information,etc., into a specified ultrasonic or sonic wave pattern or a BLE signal,and transmitting the information to the second electronic device 2405 orthe third electronic device 2409. The second electronic device 2405 orthe third electronic device 2409 is capable of determining video calldata to be transmitted to the fourth electronic device 2411, based onthe received information regarding the fourth electronic device 2411,and displaying the video call data on the display unit. When the secondelectronic device 2405 or the third electronic device 2409 detects aninput for selecting the determined video call data, it is capable ofswitching a video call to the fourth electronic device 2411.

In various embodiments of the present disclosure, the third electronicdevice 2409 is capable of discovering nearby electronic devices to beconnectable via a video call during a video call connection waiting, anddisplaying the discovered electronic devices. The third electronicdevice 2409 is capable of selecting one of the displayed electronicdevices to be connectable via a video call.

In various embodiments of the present disclosure, the third electronicdevice 2409 is capable of temporarily registering the fourth electronicdevice 2411 in an account server in the process of discovering andregistering nearby electronic devices to be connectable via a videocall.

FIG. 25 is a signal flow diagram illustrating an example method ofswitching a video call to a fourth electronic device, flowing signalsbetween first, second and fourth electronic devices, according tovarious example embodiments of the present disclosure.

With reference to FIG. 25, a fourth electronic device 2507 (e.g., thefourth electronic device 2411 illustrated in FIG. 24) is capable ofrequesting a second electronic device 2503 (e.g., the second electronicdevice 403 illustrated in FIG. 4, the second electronic device 603illustrated in FIG. 6, the second electronic device 703 illustrated inFIG. 7, the second electronic device 803 illustrated in FIG. 8, thesecond electronic device 903 illustrated in FIG. 9, the secondelectronic device 1123 illustrated in FIG. 11, the second electronicdevice 1215 illustrated in FIG. 12, the second electronic device 1703illustrated in FIGS. 17A and 17B, or the second electronic device 2405illustrated in FIG. 24) to switch a video call, and transmittinginformation regarding the fourth electronic device 2507 to the secondelectronic device 2503 in operation 2511. When the second electronicdevice 2503 receives information regarding the fourth electronic device2507 and a video call switching request signal from the fourthelectronic device 2507, it is capable of transmitting, to the fourthelectronic device 2507, a signal for authenticating the fourthelectronic device 2507 and a signal for accepting the video callswitching request by the fourth electronic device 2507 in operation2513. The second electronic device 2503 is capable of transmittinginformation regarding the video call connection with the firstelectronic device 2501 (e.g., the first electronic device 401illustrated in FIG. 4, the first electronic device 601 illustrated inFIG. 6, the first electronic device 701 illustrated in FIG. 7, the firstelectronic device 801 illustrated in FIG. 8, the first electronic device901 illustrated in FIG. 9, the first electronic device 1401 illustratedin FIG. 14A, the first electronic device 1701 illustrated in FIGS. 17Aand 17B, or the first electronic device 2401 illustrated in FIG. 24) tothe fourth electronic device 2507 in operation 2515. The secondelectronic device 2503 is capable of transmitting information regardingthe fourth electronic device 2507 to the first electronic device 2501 inoperation 2517. The first electronic device 2501 is capable ofdetermining an encoding scheme, based on the information regarding thefourth electronic device 2507, in operation 2519, and encoding videodata based on the encoding scheme in operation 2521. The firstelectronic device 2501 is capable of transmitting the encoded video datato the fourth electronic device 2507 and switching a video call to thefourth electronic device 2507 in operation 2523. The fourth electronicdevice 2507 is capable of reproducing the received, encoded video datain operation 2525. The fourth electronic device 2507 receives a voiceusing the microphone (e.g., the microphone 563) in operation 2527, andtransmits the voice signal to the second electronic device 2503 inoperation 2529. The second electronic device 2503 is capable offorwarding the received voice signal to the first electronic device 2501in operation 2531. Therefore, the first electronic device 2501 and thefourth electronic device 2507 perform a video call with each other.

Although the embodiment is described in such a way that the secondelectronic device 2503 controls a video call switching to the fourthelectronic device 2507, it should be understood that the presentdisclosure is not limited thereto. For example, although it is not shownin FIG. 25, a third electronic device (e.g., the third electronic device405 illustrated in FIG. 4, the third electronic device 605 illustratedin FIG. 6, the third electronic device 705 illustrated in FIG. 7, thethird electronic device 805 illustrated in FIG. 8, the third electronicdevice 905 illustrated in FIG. 9, the third electronic device 1413illustrated in FIG. 14A, the third electronic device 1505 illustrated inFIG. 15, the third electronic device 1705 illustrated in FIGS. 17A and17B, or the third electronic device 2409 illustrated in FIG. 24) maycontrol a video call switching to the fourth electronic device 2507.

In various embodiments of the present disclosure, when a video call isswitched to the fourth electronic device 2507, the first electronicdevice 2501 and the fourth electronic device 2507 perform a video callwith each other, via the relay of the second electronic device 2503.Alternatively, when a video call is switched to the fourth electronicdevice 2507, the first electronic device 2501 and the fourth electronicdevice 2507 perform a video call with each other via a standalonenetwork (e.g., the third network 2413 illustrated in FIG. 24) 2415,without the relay of the second electronic device 2503.

In another embodiment, while the second electronic device 2503 performsa video call with the first electronic device 2501, it is capable ofreceiving a video call request signal from a standalone device, e.g.,the fourth electronic device 2507. In various embodiments of the presentdisclosure, the second electronic device 2503 is capable of establishinga new video call connection with the fourth electronic device 2507,while maintaining a video call with the first electronic device 2501,thereby performing a three-way video call. The newly joined, fourthelectronic device 2507 is capable of obtaining information regarding thevideo call connection with the first electronic device 2501 from thesecond electronic device 2503. The fourth electronic device 2507 iscapable of joining a video call with the second electronic device 2503,based on the obtained information regarding the video call connectionwith the first electronic device 2501, thereby performing a three-wayvideo call with the first electronic device 2501. That is, the firstelectronic device 2501, the second electronic device 2503, and thefourth electronic device 2507 are capable of performing a three-wayvideo call, and the second electronic device 2503 and the fourthelectronic device 2507 are capable of performing a one-to-one video callwith the first electronic device 2501. Various embodiments of thepresent disclosure enable the second electronic device 2503 to make avideo call with the first electronic device 2501, without providinginformation regarding the second electronic device 2503 to other nearbydevices, thereby increasing a user's usability of video call service.

In various embodiments of the present disclosure, after switching avideo call to the fourth electronic device 2507, the second electronicdevice 2503 may maintain the authority for controlling a video call ofthe fourth electronic device 2507 or the fourth electronic device 2507to which the video call is switched may control the video call.

FIG. 26 is a signal flow diagram illustrating an example method ofswitching a video call to a fourth electronic device using an accountmanagement server, flowing signals between first, second and fourthelectronic devices, according to various example embodiments of thepresent disclosure.

With reference to FIG. 26, various example embodiments of the presentdisclosure are capable of switching a video call from a third electronicdevice (e.g., the third electronic device 405 illustrated in FIG. 4, thethird electronic device 605 illustrated in FIG. 6, the third electronicdevice 705 illustrated in FIG. 7, the third electronic device 805illustrated in FIG. 8, the third electronic device 905 illustrated inFIG. 9, the third electronic device 1413 illustrated in FIG. 14A, thethird electronic device 1505 illustrated in FIG. 15, the thirdelectronic device 1705 illustrated in FIGS. 17A and 17B, or the thirdelectronic device 2409 illustrated in FIG. 24) to a fourth electronicdevice 2607 (e.g., the fourth electronic device 2411 illustrated in FIG.24, the fourth electronic device 2507 illustrated in FIG. 25), using anaccount management server 2600. The fourth electronic device 2607 iscapable of requesting the second electronic device 2603 (e.g., thesecond electronic device 403 illustrated in FIG. 4, the secondelectronic device 603 illustrated in FIG. 6, the second electronicdevice 703 illustrated in FIG. 7, the second electronic device 803illustrated in FIG. 8, the second electronic device 903 illustrated inFIG. 9, the second electronic device 1123 illustrated in FIG. 11, thesecond electronic device 1215 illustrated in FIG. 12, the secondelectronic device 1703 illustrated in FIGS. 17A and 17B, the secondelectronic device 2405 illustrated in FIG. 24, or the second electronicdevice 2503 illustrated in FIG. 25) to switch a video call, andtransmitting its information to the second electronic device 2603 inoperation 2611. When the second electronic device 2603 receives a videocall switching request signal and information regarding the fourthelectronic device 2607, it is capable of authenticating the fourthelectronic device 2607 in operation 2613. The second electronic device2603 is capable of transmitting, to the fourth electronic device 2607, asignal for accepting the video call switching request by the fourthelectronic device 2607 in operation 2615.

Although the embodiment is described in such a way that the secondelectronic device 2603 authenticates the fourth electronic device 2607in operation 2613, it should be understood that the present disclosureis not limited thereto. For example, the embodiment may be modified insuch a way that a third electronic device, connected to an electronicdevice performing a video call, e.g., the second electronic device 2603via a second network (e.g., the second network 413 illustrated in FIG.4, the second network 1531 illustrated in FIG. 15, or the second network2407 illustrated in FIG. 24), selects another electronic device, e.g.,the fourth electronic device 2607, and switches a video call, and, inthis case, it may not perform the authentication for the fourthelectronic device 2607.

The second electronic device 2603 is capable of transmitting informationregarding the video call connection with the first electronic device2601 (e.g., the first electronic device 401 illustrated in FIG. 4, thefirst electronic device 601 illustrated in FIG. 6, the first electronicdevice 701 illustrated in FIG. 7, the first electronic device 801illustrated in FIG. 8, the first electronic device 901 illustrated inFIG. 9, the first electronic device 1401 illustrated in FIG. 14A, thefirst electronic device 1701 illustrated in FIGS. 17A and 17B, the firstelectronic device 2401 illustrated in FIG. 24, or the first electronicdevice 2501 illustrated in FIG. 25) to fourth electronic device 2607 inoperation 2617.

In various embodiments of the present disclosure, the second electronicdevice 2603 is capable of temporarily registering information regardingthe fourth electronic device 2607 in a server 2600 in operation 2619.

In various embodiments of the present disclosure, the server 2600 iscapable of including a user account server. The user account server iscapable of registering and managing user accounts and users' electronicdevices. For example, the user account server is capable of managing auser's electronic device and information regarding the electronic device(e.g., status information) based on a user account. As described above,the user account server is capable of providing a method of temporarilyregistering an electronic device and performing a video call with thetemporarily registered electronic device, as well as the useraccount-based management method. For example, when the user accountserver has registered a smartphone, a tablet PC, and a watch, based on auser account, it is capable of temporarily registering an electronicdevice, e.g., a TV, without using the user account. In this case, anelectronic device performs a video call with the TV, temporarilyregistered in the user account server, without a user account.

In various embodiments of the present disclosure, the first electronicdevice 2601 is capable of receiving and updating information regardingthe fourth electronic device 2607, as an electronic device to perform avideo call, from the server 2600 in operation 2621. The secondelectronic device 2603 is capable of transmitting information regardingthe fourth electronic device 2607 to the first electronic device 2601 inoperation 2623.

In various embodiments of the present disclosure, the fourth electronicdevice 2607 is capable of making a video call connection request to thefirst electronic device 2601, based on information regarding the videocall connection with the first electronic device 2601, in operation2625. The first electronic device 2601 is capable of determining anencoding scheme, based on the information regarding the fourthelectronic device 2607, in operation 2627, and encoding video data basedon the encoding scheme in operation 2629. The first electronic device2601 is capable of transmitting the encoded video data to the fourthelectronic device 2607 and switching a video call to the fourthelectronic device 2607 in operation 2631. The fourth electronic device2607 is capable of performing a video call with the first electronicdevice 2601, reproducing the received, encoded video data in operation2633. The fourth electronic device 2607 receives a voice using themicrophone (e.g., the microphone 563) in operation 2635, and transmitsthe voice signal to the second electronic device 2603 in operation 2637.The second electronic device 2603 is capable of forwarding the receivedvoice signal to the first electronic device 2601 in operation 2639.Therefore, the first electronic device 2601 and the fourth electronicdevice 2607 perform a video call with each other.

When the video call is ended, information regarding the fourthelectronic device 2607, temporarily registered in the account managementserver 2600, may be removed.

Although the embodiment is described in such a way that the secondelectronic device 2603 controls a video call switching to the fourthelectronic device 2607, it should be understood that the presentdisclosure is not limited thereto. For example, although it is not shownin FIG. 26, a third electronic device may control a video call switchingto the fourth electronic device 2507.

In various embodiments of the present disclosure, when a video call isswitched to the fourth electronic device 2607, the first electronicdevice 2601 and the fourth electronic device 2607 perform a video callwith each other, via the relay of the second electronic device 2603.Alternatively, when a video call is switched to the fourth electronicdevice 2607, the first electronic device 2601 and the fourth electronicdevice 2607 perform a video call with each other via a standalonenetwork (e.g., the third network 2413 illustrated in FIG. 24), withoutthe relay of the second electronic device 2603.

FIG. 27 is a diagram illustrating an example user interface when a thirdelectronic device discovers nearby electronic devices and switches avideo call to an electronic device, according to various exampleembodiments of the present disclosure.

With reference to FIG. 27, a third electronic device (e.g., the thirdelectronic device 405 illustrated in FIG. 4, the third electronic device605 illustrated in FIG. 6, the third electronic device 705 illustratedin FIG. 7, the third electronic device 805 illustrated in FIG. 8, thethird electronic device 905 illustrated in FIG. 9, the third electronicdevice 1413 illustrated in FIG. 14A, the third electronic device 1505illustrated in FIG. 15, the third electronic device 1705 illustrated inFIGS. 17A and 17B, or the third electronic device 2409 illustrated inFIG. 24) is capable of discovering electronic devices to which a videocall can be switched. For example, the third electronic device iscapable of discovering electronic devices to which a video call can beswitched, via at least one of the following: BLE, Wi-Fi, and Zigbee. Thethird electronic device is capable of displaying electronic deviceswhich are connected to the same network as the third electronic deviceand to which a video call can be switched, in response to the operationfor discovering electronic devices. For example, the third electronicdevice is capable of discovering electronic devices such as homeappliances, electric apparatuses, health care devices, remote meteringdevices, smart home system, smart cars, etc., connected to a network towhich the third electronic device is connected, and sharing informationregarding the discovered electronic devices with each other.

In various embodiments of the present disclosure, electronic devices towhich a video call can be switched may or may not be registered, basedon user accounts (a user account server). When an electronic device hasbeen registered based on a user account, the third electronic device iscapable of displaying an icon (e.g., a profile photo/picture)representing the registered electronic device, along with the accountinformation. When an electronic device has not been registered based ona user account, the third electronic device is capable of displayingonly an icon of the electronic device showing a connectable state,without showing account information. In various embodiments of thepresent disclosure, the account information may be contained in thediscovery signal or may be obtained from a user account server, based onthe discovery signal.

In various embodiments of the present disclosure, when the thirdelectronic device receives an input for selecting a specified one of thediscovered electronic devices to which a video call can be switched, itis capable of controlling the first electronic device (e.g., the firstelectronic device 401 illustrated in FIG. 4, the first electronic device2401 illustrated in FIG. 24, the first electronic device 2501illustrated in FIG. 25, or the first electronic device 2601 illustratedin FIG. 26) and the selected, specified electronic device to perform avideo call to each other.

For example, as illustrated in FIG. 27, the third electronic device iscapable of displaying a pop-up window 2701 including Jesse 2703, Kathryn2705, and TV icon 2707 to which a video call can be switched, inresponse to the operation for discovering electronic devices to which avideo call can be switched. In various embodiments of the presentdisclosure, when the third electronic device discovers an electronicdevice registered based on user account, it is capable of displayingicons corresponding to electronic devices of Jesse 2703 and Kathryn2705, along with account information regarding Jesse 2703 and Kathryn2705. On the other hand, when the third electronic device discovers anelectronic device which has not been registered based on user account,it is capable of displaying only an icon 2707 representing a TV. Whenthe third electronic device receives an input for selecting one of theicons representing electronic devices of Jesse 2703 and Kathryn 2705 andTV 2707, it is capable of switching a video call to the electronicdevice or the TV corresponding to the selected icon.

In another embodiment of the present disclosure, a video call switchingoperation may also be performed via infrared communication. For example,various embodiments of the present disclosure are capable of selectingan electronic device to which a video call to be switched, by using aremote controller, an infrared light emitting unit of an electronicdevice, and a light receiving unit of a TV remote control. For example,electronic devices which need to perform a video call may exchange asignal for switching a video call and information regarding theelectronic devices with each other via infrared communication.Therefore, various embodiments of the present disclosure allow users tointuitively switch a video call from one to another electronic device.

FIG. 28 is a diagram illustrating an example connection among first tofourth electronic devices according to various example embodiments ofthe present disclosure.

Various embodiments of the present disclosure are capable of performinga video call via a chain structure of an extended connection device ortwo or more electronic devices.

With reference to FIG. 28, a first electronic device 2801 (e.g., thefirst electronic device 401 illustrated in FIG. 4, the first electronicdevice 601 illustrated in FIG. 6, the first electronic device 701illustrated in FIG. 7, the first electronic device 801 illustrated inFIG. 8, the first electronic device 901 illustrated in FIG. 9, the firstelectronic device 1401 illustrated in FIG. 14A, the first electronicdevice 1701 illustrated in FIGS. 17A and 17B, the first electronicdevice 2401 illustrated in FIG. 24, the first electronic device 2501illustrated in FIG. 25, or the first electronic device 2601 illustratedin FIG. 26) is capable of connecting to a second electronic device 2803(e.g., the second electronic device 403 illustrated in FIG. 4, thesecond electronic device 603 illustrated in FIG. 6, the secondelectronic device 703 illustrated in FIG. 7, the second electronicdevice 803 illustrated in FIG. 8, the second electronic device 903illustrated in FIG. 9, the second electronic device 1123 illustrated inFIG. 11, the second electronic device 1215 illustrated in FIG. 12, thesecond electronic device 1703 illustrated in FIGS. 17A and 17B, thesecond electronic device 2405 illustrated in FIG. 24, the secondelectronic device 2503 illustrated in FIG. 25, or the second electronicdevice 2603 illustrated in FIG. 26) via a first network 2821 (e.g., thefirst network 411 illustrated in FIG. 4, the first network 1523illustrated in FIG. 15, or the first network 2403 illustrated in FIG.24). The second electronic device 2803 is capable of connecting to athird electronic device 2805 (e.g., the third electronic device 405illustrated in FIG. 4, the third electronic device 605 illustrated inFIG. 6, the third electronic device 705 illustrated in FIG. 7, the thirdelectronic device 805 illustrated in FIG. 8, the third electronic device905 illustrated in FIG. 9, the third electronic device 1413 illustratedin FIG. 14A, the third electronic device 1505 illustrated in FIG. 15,the third electronic device 1705 illustrated in FIGS. 17A and 17B, orthe third electronic device 2409 illustrated in FIG. 24) via a secondnetwork 2823 (e.g., the second network 413 illustrated in FIG. 4, thesecond network 1531 illustrated in FIG. 15, or the second network 2407illustrated in FIG. 24). The third electronic device 2805 is capable ofconnecting to a home network server 2807 via a third network 2825. Thefourth electronic device 2809 is capable of connecting to the homenetwork server 2807 via a fourth network 2827.

In various embodiments of the present disclosure, the home networkserver 2807 allows for the connection of a number of electronic devices.The home network server 2807 is capable of connecting to an Internet ofthings (IoT) network. For example, the home network server 2807 isconnected with n^(th) electronic devices 2811 (n is a positive integer)including the fourth electronic device 2809 via n^(th) network 2829 (nis a positive integer). The home network server 2807 is capable ofregistering electronic devices over a wide area and also monitoringstatus information regarding the registered electronic devices.Therefore, users can recognize status information regarding theelectronic devices registered in the home network server 2807 andimmediately check whether electronic devices may perform a video callbased on the status information.

In various embodiments of the present disclosure, the home networkserver 2807 is capable of connecting a video call between the firstelectronic device 2801 and the third electronic device 2805 to thefourth electronic device 2809.

For example, when three or more electronic devices are connected inchain structure, one of the three or more electronic devices, in themiddle of the chain structure, e.g., the home network server 2807, iscapable of relaying information regarding the connected electronicdevices and information regarding the network to the electronic devices.

In various embodiments of the present disclosure, the home networkserver 2807 is capable of serving as an encoder. For example, the homenetwork server 2807 is capable of controlling the first electronicdevice 2801, the second electronic device 2803, the third electronicdevice 2805, and the encoder of the home network server 2807 to transmitvideo data to the fourth electronic device 2809. When the first network2821, connecting the first electronic device 2801 and the secondelectronic device 2803, the second network 2823, connecting the secondelectronic device 2803 and the third electronic device 2805, and thethird network 2825, connecting the third electronic device 2805 and thehome network server 2807, have a relatively high level of quality,respectively, the first electronic device 2801 or the second electronicdevice 2803 is capable of transmitting video data for video call to thehome network server 2807, without encoding the video data.

In various embodiments of the present disclosure, the home networkserver 2807 is capable of encoding the received video data for videocall, based on an encoding scheme, e.g., a transcoding scheme. Forexample, when the home network server 2807 employs a stationary powersupply, it may encode video data more efficiently using its power supplythan using a battery of the first electronic device 2801 or the secondelectronic device 2803.

In various embodiments of the present disclosure, the process ofencoding video data using a scalable encoding scheme is capable oftransmitting part of the layers received from individual electronicdevices to the next, connected electronic device, thereby maximizing ascalable encoding effect. For example, the first electronic device 2801is capable of transmitting a base layer and an enhanced layer #1 to thesecond electronic device 2803, according to conditions. The secondelectronic device 2803 is capable of transmitting the received baselayer and the received enhanced layer #1 to the third electronic device2805. The third electronic device 2805 detects a signal for switching avideo call to the fourth electronic device 2809, it is capable oftransmitting the base layer and the enhanced layer #1, received thesecond electronic device 2803, to the home network server 2807. The homenetwork server 2807 is capable of transmitting, to the fourth electronicdevice 2809, not all the base layer and the enhanced layer #1, receivedfrom the third electronic device 2805, but only the base layer,according to conditions.

Various embodiments of the present disclosure are capable of switching avideo call, based on the third electronic device 2805 or the homenetwork server 2807.

FIG. 29 is a flowchart illustrating an example multiple connectionmethod according to various example embodiments of the presentdisclosure.

In various embodiments of the present disclosure, a second electronicdevice (e.g., the second electronic device 403 illustrated in FIG. 4,the second electronic device 603 illustrated in FIG. 6, the secondelectronic device 703 illustrated in FIG. 7, the second electronicdevice 803 illustrated in FIG. 8, the second electronic device 903illustrated in FIG. 9, the second electronic device 1123 illustrated inFIG. 11, the second electronic device 1215 illustrated in FIG. 12, thesecond electronic device 1703 illustrated in FIGS. 17A and 17B, thesecond electronic device 2405 illustrated in FIG. 24, the secondelectronic device 2503 illustrated in FIG. 25, the second electronicdevice 2603 illustrated in FIG. 26, or the second electronic device 2803illustrated in FIG. 28) or a third electronic device (e.g., the thirdelectronic device 405 illustrated in FIG. 4, the third electronic device605 illustrated in FIG. 6, the third electronic device 705 illustratedin FIG. 7, the third electronic device 805 illustrated in FIG. 8, thethird electronic device 905 illustrated in FIG. 9, the third electronicdevice 1413 illustrated in FIG. 14A, the third electronic device 1505illustrated in FIG. 15, the third electronic device 1705 illustrated inFIGS. 17A and 17B, the third electronic device 2409 illustrated in FIG.24, or the third electronic device 2805 illustrated in FIG. 28),connected to the second electronic device, is capable of independentlyperforming a multiple video call. In various embodiments of the presentdisclosure, when a multiple video call is performed via the secondelectronic device or the third electronic device connected to the secondelectronic device, the second or third electronic device is capable ofperforming a first video call, e.g., a video calling which is performedin a normal way by transmitting/receiving video and voice signals, and asecond video call with another electronic device newly joined, e.g., avideo calling which is performed in such a way as to transmit/receive avideo data, using a speech to text (STT) or text to speech (TTS)function.

With reference to FIG. 29, the third electronic device is capable ofperforming a first video call in operation 2901. For example, the thirdelectronic device has been performing a first video call, via a tabletPC.

The third electronic device is capable of receiving a second video callrequest from a newly joined electronic device in operation 2903. Forexample, the third electronic device is capable of receiving a secondvideo call request from a new electronic device while performing a firstvideo call via the tablet PC.

The third electronic device is capable of accepting a second video callin operation 2905. For example, the third electronic device is capableof: selecting another electronic device, e.g., a TV or a car kit,instead of the tablet PC, as an electronic device to perform a secondvideo call; and perform a second video call with the newly selectedelectronic device.

The third electronic device is capable of displaying first video datafor a first video call and second video data for a second video call inoperation 2907. For example, the first video call is referred to as anormal video call performed in such a way as to transmit/receive videoand voice signals. The second video call is referred as a video callperformed in such a way as to process voice information using an STT/TTSfunction, while displaying only an image on screen. For example, thethird electronic device is capable of displaying subtitles for the voiceinformation. When the third electronic device detects an input forentering characters/letters/text, it is capable of transmitting voicesignals for the received characters/letters/text to the other party'selectronic device. The third electronic device may employ a separateinput device for entering characters/letters/text, e.g., a Bluetoothkeyboard.

In various embodiments of the present disclosure, the third electronicdevice is capable of discerning between an enabled video call and avideo call in an idle state (e.g., a disenabled video call), using acontrol device, e.g., a watch, etc. For example, the third electronicdevice is capable of transmitting/receiving a voice signal when a videocall is enabled. When the third electronic device receives a voicesignal from the other party's electronic device when a video call is inan idle state, it is capable of notifying the user that a voice signalhas been received from the other party's electronic device, byoutputting a notification, vibration, blinking, a beep sound, etc.

In various embodiments of the present disclosure, the third electronicdevice is capable of performing a first video call and a second videocall in operation 2909. For example, the third electronic device iscapable of splitting its screen into two areas and displaying firstvideo data for a first video call on one of the two areas (a first area)and second video data for a second video call on the other area (asecond area). The two split areas may be adjusted by the user. Asdescribed above, the first video call and the second video call aresimultaneously performed in such a way that the first video call isperformed as a normal video call and the second video call is performedusing an STT/TTS function. Various embodiments are capable of discerningbetween an enabled video call and a video call in an idle state, andsimultaneously performing a first video call and a second video call. Invarious embodiments of the present disclosure, notifications accordingto voice information may be displayed via individual windows. The thirdelectronic device may output a notification via a watch.

FIG. 30 is a flowchart illustrating an example method of storing videodata according to various embodiments of the present disclosure.

In various embodiments of the present disclosure, a second electronicdevice (e.g., the second electronic device 403 illustrated in FIG. 4,the second electronic device 603 illustrated in FIG. 6, the secondelectronic device 703 illustrated in FIG. 7, the second electronicdevice 803 illustrated in FIG. 8, the second electronic device 903illustrated in FIG. 9, the second electronic device 1123 illustrated inFIG. 11, the second electronic device 1215 illustrated in FIG. 12, thesecond electronic device 1703 illustrated in FIGS. 17A and 17B, thesecond electronic device 2405 illustrated in FIG. 24, the secondelectronic device 2503 illustrated in FIG. 25, the second electronicdevice 2603 illustrated in FIG. 26, or the second electronic device 2803illustrated in FIG. 28) receiving a video call or a third electronicdevice (e.g., the third electronic device 405 illustrated in FIG. 4, thethird electronic device 605 illustrated in FIG. 6, the third electronicdevice 705 illustrated in FIG. 7, the third electronic device 805illustrated in FIG. 8, the third electronic device 905 illustrated inFIG. 9, the third electronic device 1413 illustrated in FIG. 14A, thethird electronic device 1505 illustrated in FIG. 15, the thirdelectronic device 1705 illustrated in FIGS. 17A and 17B, the thirdelectronic device 2409 illustrated in FIG. 24, or the third electronicdevice 2805 illustrated in FIG. 28) connected to the second electronicdevice is capable of storing video call according to a user's setting ora user's selection. For example, a screen or voices of the video datamay be stored. Alternatively, a screen and voices are stored together.

With reference to FIG. 30, the third electronic device performs a videocall in operation 3001. During a video call, the third electronic deviceis capable of detecting an input for storing video data in operation3003. When detecting an input for storing video data, the thirdelectronic device is capable of transmitting the detected input to thesecond electronic device. The second electronic device is capable ofrequesting the first electronic device performing a video call totransmit video data to store a video, based on the received input. Forexample, when the second electronic device receives an input forcapturing or storing a specified screen from the third electronicdevice, while reproducing video data for video call, it is capable ofrequesting the first electronic device, which creates the video data forperforming a video call, to transmit video data for the specifiedscreen, e.g., images. When the first electronic device receives arequest for transmission of video data for a specified screen from thesecond electronic device, it is capable of extracting video callcorresponding to the specified screen and transmitting the extractedvideo data to the second electronic device. The first electronic deviceis capable of transmitting high quality of images, referred to as imagesnot re-processed considering network status information, etc., to thesecond electronic device. The high quality of images may be transmittedvia a control signal channel or a newly established channel.

In various embodiments of the present disclosure, the third electronicdevice is capable of storing video data in operation 3005. For example,the third electronic device is capable of storing video call for aspecified screen, based on external conditions of the second or thirdelectronic device. For example, when the first electronic device is inan external environment where it is bright and nosy, and the secondelectronic device is in an external environment where it is dark andquiet, the third electronic device is capable of storing video call fora specified screen at a low level of brightness and a low level ofvolume corresponding to the external condition of the second electronicdevice. That is, images or voices may be captured and stored,considering information regarding the surrounding environment of thesecond or third electronic device.

In various embodiments of the present disclosure, when the thirdelectronic device transmits an input for storing a video running on ascreen to the second electronic device, it may receive video data beforevideo-processing from the second electronic device and may store thereceived video data. Therefore, the user's electronic device is capableof obtaining higher quality of video data. In this case, the video maybe transmitted to and stored in the third electronic device or may bestored in the second electronic device. For example, when an externalTV, as an electronic device to provide a video call service, istemporarily selected, the third electronic device is capable of storingthe video in the second or third electronic device, instead of the TVproviding a video call service. That is, an electronic device to storevideo data may be set according to attributes of the electronic device,e.g., a condition as to whether the account is registered, a conditionas to whether a type of electronic device is a device for public use,etc.

In various embodiments of the present disclosure, the video may bestored in a cloud storage. The cloud storage may include a cloud storageof electronic device owner's account, a cloud server of an accountreceiving a video call service, etc. The cloud storage may be selectedby the user or according to attributes of an electronic device, e.g., acondition as to whether the account is registered, a condition as towhether a type of electronic device is a device for public use, etc.

In various embodiments of the present disclosure, when the thirdelectronic device stores video data, e.g., a video and voices, it iscapable of inserting a meta tag, e.g., a video call time, a place wherea video call is made, or information regarding an electronic device, inthe video data or marking a video or an image with a watermark shape.

In various embodiments of the present disclosure, when the thirdelectronic device needs to store video data in small size or onlyvoices, it is capable of extracting key frames and storing them using animage sliding method. For example, the third electronic device iscapable of extracting key frames from video data for an interval of 10minutes and storing the frames using an image sliding method. Therefore,various embodiments of the present disclosure are capable of storingvideo data reduced in storage capacity. The video may be stored in aformat, synchronized with voice.

In various embodiments of the present disclosure, the stored video datamay be inserted into or removed from a specified image via an editor.Voice and video of existing video data may be synchronized with eachother, regardless of inserted/removed images.

FIG. 31 is a diagram illustrating an example configuration of softwareaccording to various example embodiments of the present disclosure.

With reference to FIG. 31, various embodiments of the present disclosureare capable of providing a video calling method and a user interface,using application programming interface (API). Various embodiments ofthe present disclosure allow applications of electronic devicemanufacturers and third party applications to execute a video call andprovide a corresponding user interface, using the API. For example, whenan API 3105 calls an API-Calling components 3101 for parameters forperforming a video call 3109, it is capable of receiving a parameterreturn value 3103 from the API-Calling components 3101. The API iscapable of transferring the parameter return value 3103 to theAPI-Implementing components 3107. The API-Implementing components 3107are capable of implementing a user interface for performing a videocall, using the parameter return value 3103.

As described above, the video encoding method according to variousembodiments of the present disclosure enables an electronic devicereceiving a video call to provide video data suitable for video callingto a wearable device connected to the electronic device, so that theuser can easily make the video call with the wearable device on his/herbody. The electronic device is adapted to the video encoding method.

The video encoding method according to various embodiments of thepresent disclosure is capable of analyzing states of a wearable device,in real time, and providing encoded video data, based on the analysisresult, to the wearable device, so that the wearable device can smoothlymake a video call although the wearable device has a limited batterylevel and a limited transfer rate. The electronic device is adapted tothe video encoding method.

Although the video encoding method and electronic device adapted theretoaccording to various embodiments have been described, the scope of thedisclosure is not limited thereto, and various changes and modificationscan be made without departing from the essential features of thedisclosure by those skilled in the art. Accordingly, the embodimentsdisclosed are provided merely for describing, but not limiting, thetechnical idea of the disclosure, and the scope of the technical idea ofthe disclosure is not limited by the various example embodiments. Thescope of the disclosure should be construed by the appended claims, andall technical ideas within a range equivalent to the scope should beunderstood as being included in the scope of the disclosure.

What is claimed is:
 1. An electronic device comprising: a wirelesscommunication circuit configured to communicate with a first electronicdevice; a touchscreen configured to display a user interface forperforming a video call; a speaker; a microphone; one or more processorselectrically connected to the communication circuit, the touchscreen,the speaker, and the microphone; and a memory electrically connected tothe one or more processors, wherein the memory stores instructions that,when executed, cause the one or more processors to: receive a signalrelated to an incoming video call from the first electronic device viathe wireless communication circuit; receive a user input accepting thevideo call via the user interface; transmit a signal accepting the videocall to the first electronic device via the wireless communicationcircuit in response to the user input; receive a video stream from thefirst electronic device via the wireless communication circuit, whereinthe video stream has been adapted at the first electronic device, basedat least partly on: status information on the electronic device and/orstatus information on wireless communication between the electronicdevice and the first electronic device; display the received videostream on the touchscreen while providing voice from the video call,using the speaker; receive voice, using the microphone; and transmit thereceived voice to the first electronic device, using the wirelesscommunication circuit.
 2. The electronic device of claim 1, wherein theinstructions further cause the one or more processors to: detect analteration in a state of the electronic device or an alteration in astate of the wireless communication; and receive a video steam, whichdiffers from the received video stream by at least one of: a resolution,picture quality, and a frame rate, from the first electronic device viathe wireless communication circuit, wherein the status information onthe electronic device includes at least one of: a type of the electronicdevice, a size of the touchscreen, processing power of the processor, amaximum resolution of the touchscreen, a battery status or level, memorystatus or capacity, or presence/absence of a camera, and the statusinformation on the communication includes a video call quality level forperforming a video call.
 3. The electronic device of claim 2, furthercomprising: a camera, wherein the instructions further cause the one ormore processors to: adapt a video stream taken by the camera, based atleast partly on the status information on the electronic device and thestatus information on the wireless communication circuit; and transmitthe adapted video stream to the first electronic device via thecommunication.
 4. The electronic device of claim 3, wherein theinstructions further cause the one or more processors to: detect atleast one of a face or an iris of the user via the camera whilereceiving the video stream; and display the received video stream on thetouchscreen only while at least one of a face or an iris of the user isdetected.
 5. The electronic device of claim 1, wherein the instructionsfurther cause the one or more processors to: display an indicator toadjust a quality of the received video stream; detect an input foradjusting the quality of video stream via the indicator; determine anencoding scheme corresponding to the adjusted quality of video stream;transmit the determined encoding scheme to the first electronic device;receive a video stream, adapted based on the encoding scheme, from thefirst electronic device; and display the received video stream.
 6. Theelectronic device of claim 1, wherein the instructions further cause theone or more processors to: set a region of interest (ROI) in thedisplayed video stream; transmit the ROI to the first electronic device;receive, from the first electronic device, a video stream, adapted basedon at least one of: focus, crop, change in picture quality, or exposureadjustment, with respect to the ROI; and display the received videostream.
 7. The electronic device of claim 1, further comprising at leastone motion sensor wherein the instructions further cause the one or moreprocessors to: detect orientation of the electronic device using thesensor, while receiving the video stream; and display the received videostream on the touchscreen only while the detected orientation is in aselected range.
 8. The electronic device of claim 1, wherein theinstructions further cause the one or more processors to: display thereceived video stream; receive a user input for forwarding the videocall; display at least one external display device to which the videocall can be forwarded; receive a user selection of one of the at leastone external display device; and forward the video call to the selectedexternal display device.
 9. The electronic device of claim 1, whereinthe instructions further cause the one or more processors to: analyzethe status information on the electronic device and the statusinformation on the wireless communication; and display a selectable theuser interface on the touchscreen, wherein the user interface isindicative of at least one operation related to the video call, based onthe analyzed status information on the electronic device and theanalyzed status information on the wireless communication, wherein theoperation is related to at least one of a quality of the video stream, avoice only call, a video call using a second electronic device, or avoice call using the second electronic device.
 10. The electronic deviceof claim 1, wherein the instructions further cause the one or moreprocessors to: receive another video call request via the firstelectronic device from a third electronic device while performing thevideo call; detect an input for accepting the received video callrequest; further receive a video stream of the other video call via thefirst electronic device from the third electronic device; and display ascreen of the video call on a first region of the touchscreen, andanother screen of the other video call on a second region of thetouchscreen.
 11. The electronic device of claim 1, further comprising apressure detection sensor, wherein the instructions further cause theone or more processors to: detect an input pressing against thetouchscreen while providing voice from the video call, using thespeaker; determine a pressure level of the detected input; and performan operation, based at least partly on the detected pressure level. 12.The electronic device of claim 1, wherein the instructions further causethe one or more processors to: detect a touch gesture input using thetouchscreen, while providing voice from the video call, using thespeaker; determine a direction of the input; and perform an operation,based at least partly on the detected direction.
 13. The electronicdevice of claim 1, wherein the instructions further cause the one ormore processors to: detect an input via the touchscreen for storing atleast a portion of the received video stream; and transmit, to the firstelectronic device, a request for storing, in the first electronicdevice, the at least a portion of the video stream, wherein the requestincludes information on time when the input is detected.
 14. Theelectronic device of claim 1, wherein the instructions further cause theone or more processors to: receive, from the first electronic device,information on at least one electronic device capable of performing thevideo call; display an indication of the at least one electronic deviceon the touchscreen; receive a user input for selecting one of the atleast one electronic device; and transmit a signal for forwarding thevideo call to the selected electronic device to the first electronicdevice, using the wireless communication circuit.
 15. The electronicdevice of claim 1, wherein: the wireless communication circuit comprisesat least one of: a Bluetooth modem or Wi-Fi modem.
 16. The electronicdevice of claim 1, wherein the electronic device is smartwatch and thefirst electronic device is a smartphone.
 17. An electronic devicecomprising: a first wireless communication circuit configured tocommunicate with a first electronic device; a second wirelesscommunication circuit configured to communicate with a second electronicdevice; a touchscreen configured to display a user interface to performa video call; a speaker; a microphone; one or more processorselectrically connected to the first wireless communication circuit, asecond wireless communication circuit, the touchscreen, the speaker, andthe microphone; and a memory electrically connected to the one or moreprocessors, wherein the memory stores instructions that, when executed,cause the one or more processors to: receive a video call request fromthe first electronic device via the first wireless communicationcircuit; display the received video call request on the touchscreen;create a notification based on the received video call request; transmitthe created notification to the second electronic device via the secondwireless communication; receive a signal accepting the video callrequest from the second electronic device via the second wirelesscommunication circuit; stop displaying the video call request inresponse to the received signal accepting the video call request;receive and adapt a video stream from the first electronic device, basedat least partly on status information on the second electronic deviceand status information on the communication between the electronicdevice and the second electronic device; transmit the adapted videostream to the second electronic device via the second wirelesscommunication circuit; and transmit voice, received from the secondelectronic device via the second wireless communication circuit, to thefirst electronic device via the first wireless communication circuit.18. The electronic device of claim 17, wherein the instructions furthercause the one or more processors to: receive, from the second electronicdevice, at least one of a maximum resolution, a maximum level of picturequality, or a maximum frame rate (fps) of a video stream supported bythe second electronic device; adapt at least one of a resolution, alevel of picture quality, or a fps of the video stream within the atleast one of a maximum resolution, a maximum level of picture quality,or a maximum fps, based at least partly on the status information on thecommunication.
 19. The electronic device of claim 17, wherein theinstructions further cause the one or more processors to: receive, froma third electronic device, a video call forwarding request andinformation on the third electronic device; transmit video callconnection information to the third electronic device; and transmitinformation on the third electronic device to the first electronicdevice via the first wireless communication circuit.
 20. An electronicdevice comprising: a first wireless communication circuit configured tocommunicate with a first electronic device; a touchscreen configured todisplay a user interface to perform a video call; a speaker; amicrophone; one or more processors electrically connected to the firstwireless communication circuit, the touchscreen, the speaker, and themicrophone; and a memory electrically connected to the one or moreprocessors, wherein the memory stores instructions that, when executed,cause the one or more processors to: transmit a video call requestsignal to the first electronic device via the first wirelesscommunication circuit; via the first wireless communication circuit,receive, from the first electronic device, a signal accepting the videocall request, status information on a second electronic device, andstatus information on communication between the first electronic deviceand the second electronic device; adapt a video stream, based at leastpartly on the received status information on the second electronicdevice and the received status information on the communication;transmit the adapted video stream to the first electronic device via thefirst wireless communication circuit; and receive a voice from the firstelectronic device.